Data Engineer

This job was posted by https://www.azjobconnection.gov : For more
information, please see: https://www.azjobconnection.gov/jobs/6706879
Zapata Technology

Referral Eligible

Summary: Zapata Technology is seeking an experienced Software / Data
Engineer for a remote role. The Data Engineer will lead the
transformation of our data infrastructure, utilizing a custom ASP.NET
application, Postgres stored procedures, and migrating existing VBA
scripts to modern platforms to build and manage ETL processes. This
position is required to meet the customers current needs but must also
be prepared to transition to modern ETL tools such as Apache NiFi and
Airflow in the future. The ideal candidate will have extensive
experience in data engineering, database management, and designing
efficient ETL workflows without relying on traditional ETL tools.

Check out the details below and our awesome benefits
[here](https://www.zapatatechnology.com/careers/benefits/){target=”blank”}.

Job Qualifications:

Qualifications and skills include:

– Design and develop modular ETL solutions that ingest and deliver
data from various systems to analytics platforms, using custom
ASP.NET applications and Postgres stored procedures.
– Experience in developing and maintaining scalable data storage
systems, particularly in Postgres or other relational databases.
– Proficiency in writing efficient SQL queries and stored procedures
to process and transform structured and unstructured data.
– Experience in designing scalable data pipelines for reporting and
analytics, using manual coding techniques rather than third-party
ETL applications.
– Strong ability to collaborate with cross-functional teams to create
and implement custom data solutions.
– Skilled in developing custom scripts and applications to support
data transformation and management needs.
– Experience documenting data processes, managing compliance
requirements, and conducting quality assurance tasks.
– Ability to troubleshoot and resolve data quality issues and ensure
system integrity.
– Familiarity with metadata management, ensuring compliance with data
governance frameworks, including HRPP/Privacy/HIPAA/SOP.
– CompTIA Security certification, demonstrating a commitment to
security and compliance standards.
– Computing Environment Certification.

Preferred Qualifications and Skills include:

– Experience with ASP.NET, C#, and related web application development
frameworks.
– Advanced knowledge of Postgres, particularly in writing complex
stored procedures, query optimization, and transitioning data
infrastructure to Postgres.
– Strong familiarity with AWS cloud environments, with experience in
migrating data systems to AWS.
– Experience with low-code/no-code platforms and distributed data
processing tools such as Spark, Databricks, or similar.
– Knowledge of real-time data processing, streaming applications, and
data warehousing concepts, especially in cloud-native environments.
– Proficiency in shell scripting and automation to support cloud
migrations and system integrations.
– Experience working in Agile methodologies, particularly within
cloud-based or hybrid cloud environments.

Education/Experience

PI250416352

Zapata Technology is an Equal Opportunity Employer and does not
discriminate against any applicants for employment based on their race,
color, religion, sex (including pregnancy, sexual orientation, or gender
identity), national origin, age, physical or mental disability, genetic
information, veteran status, uniformed service member status, or any
other status protected by law.