Job Description

📢 Hiring for: DATA ENGINEER

Fully Remote

Data Engineer with strong AWS and modern data platform experience to integrate an enterprise AI application with Snowflake, Databricks, and other cloud data sources. This role is responsible for building secure data pipelines, orchestrating ingestion and transformations, optimizing data flows for RAG pipelines, and ensuring high-quality, clean, governed data is available for AI inference and vectorization workflows.

Responsibilities

• Build and maintain ingestion, transformation, and orchestration pipelines using AWS Glue, Lambda, Step Functions, EMR, and Databricks.
• Create and optimize data flows that support AI applications, including RAG retrieval datasets, feature generation, and embedding pipelines.
• Design and implement secure data connectivity between AWS VPC/private cloud environments and Snowflake/Databricks using PrivateLink, VPC endpoints, and IAM identity policies.
• Develop scalable ETL/ELT workflows for structured, semi-structured, and unstructured data.
• Optimize query performance, indexing, Delta Lake processing, and data partitioning.
• Manage data governance and lineage (Lake Formation, Glue Catalog, log tracking).
• Implement encryption, secrets management, and access control for sensitive data used in AI workflows.
• Collaborate closely with AI developers on data formats, schemas, and dataset preparation for embeddings and inference.
• Create automated jobs for refreshing RAG knowledge bases and vector stores.

Required Skills

• Strong data engineering experience on AWS (S3, Glue, Lambda, Step Functions, EMR).
• Hands-on Snowflake experience (warehousing, Snowpipe, performance tuning).
• Hands-on Databricks experience (Delta Lake, Spark, notebooks, pipelines).
• Strong knowledge of secure VPC/private cloud connectivity patterns (PrivateLink, VPC endpoints).
• Experience with Terraform or AWS CDK for IaC automation.
• Strong knowledge of encryption, secrets management, and data governance.

Preferred

• Experience supporting AI applications, vector databases, or embedding pipelines.
• Familiarity with RAG architecture and data requirements for AI retrieval systems.

We are Connectors. We thrive on quality over quantity and put in the work building strong relationships. We create connections, discover qualities, uncover skills, and place people with accuracy. We are your true partner!

We are Collaborators. Youll be working with a wholly owned subsidiary of Kelly and part of the Kelly Telecom division. It allows us to be as nimble and fiercely competitive as a startup while having the backing of a multibillion dollar publicly traded company which has been in business for 75 years. With direct access to hiring managers, services dont stop at standard recruiting processes. We use our expertise to improve your application skills and provide ongoing career support.

We give 24/7 Support. We are in this together. We provide around the clock availability, competitive employee benefits, and continuously check-in to make sure things are going smoothly. Check out our Glassdoor page!

Job Tags

Similar Jobs