Lead Data Engineer Job at Openkyber, Idaho

VXZxMTBsVURycGk4YzVEVytnc0JOengwaHc9PQ==
  • Openkyber
  • Idaho

Job Description

Senior Data Engineer Charlotte, NC Position Overview We are seeking an experienced Senior Data Engineer to lead critical data infrastructure, database modernization, and migration initiatives supporting a next-generation application platform. This role will be responsible for building a scalable data foundation while transitioning large-scale legacy systems to a modern AWS cloud architecture. The ideal candidate brings deep expertise in PostgreSQL, Oracle-to-PostgreSQL migrations, AWS, data modeling, and real-time data processing .

Key Responsibilities:
  • Design and build PostgreSQL databases, schemas, and data models from the ground up , with a focus on performance, scalability, and maintainability.
  • Lead large-scale Oracle-to-PostgreSQL migrations , moving databases from on-premises environments to AWS RDS PostgreSQL while maintaining data integrity and minimizing downtime.
  • Analyze existing database schemas and recommend structural, performance, and scalability improvements.
  • Build and optimize real-time data pipelines and products using Apache Kafka, Apache Flink, and Apache Hudi or similar lakehouse technologies.
  • Design and implement Change Data Capture (CDC) and auditing solutions to track data changes, lineage, and historical activity.
  • Develop normalized and denormalized data models supporting both OLTP and analytical workloads .
  • Establish data validation and quality controls throughout migration and modernization efforts.
  • Develop and maintain data catalogs, schema documentation, and architectural documentation for application and engineering teams.
  • Partner with application developers, architects, infrastructure teams, and business stakeholders throughout modernization initiatives.
  • Ensure appropriate data security, access controls, encryption, and compliance practices.
Required Qualifications:
  • Strong hands-on expertise with PostgreSQL , including database architecture, schema design, SQL, administration, performance tuning, and optimization.
  • Demonstrated experience performing large enterprise database migrations ; Oracle-to-PostgreSQL experience is strongly preferred.
  • Hands-on AWS experience, particularly RDS, EC2, networking, and security .
  • Experience with Apache Kafka and Apache Flink for streaming and real-time data processing.
  • Experience with Apache Hudi, Delta Lake, or comparable lakehouse technology .
  • Strong understanding of relational database design and normalized/denormalized data modeling .
  • Experience implementing CDC, audit logging, data lineage, and change-tracking solutions .
  • Ability to evaluate legacy database structures and design improved schemas for modern applications.
  • Strong technical documentation and stakeholder communication skills.
Preferred Qualifications:
  • AWS data services such as Glue, Lambda, and Step Functions .
  • Data quality and validation frameworks.
  • Terraform or CloudFormation .
  • Application modernization or legacy platform replacement experience.
  • Knowledge of data security, encryption, and regulatory requirements such as GDPR or HIPAA .

For applications and inquiries, contact:hirings@openkyber.com

Job Tags

Similar Jobs

Fresh Consulting

Sr Mechatronics Engineer Job at Fresh Consulting

 ...solutions, faster, and at lower cost? Are you an Automation Engineer or have a strong background in automated systems deployed in high...  ...See more at freshconsulting.com What We Need The Mechatronics Engineer will join a team of professionals designing and... 

Nashville Rescue Mission

Life Coach 2 - Men’s Life Recovery Job at Nashville Rescue Mission

 ...team, and upholds the Missions Statement of Faith and Code of Conduct at all times. Are you the right person?Youre an encouraging mentor.You have a desire to help others. You are able to draw upon your own personal growth experience to carry the message of hope to... 

KFC

Restaurant General Manager Job at KFC

 ...When you join KFC, you join our Family! Our KFC Family takes pride in our high quality standards, southern-inspired hospitality and serving guests our world-famous chicken! We have a passion for people - not only our guests - we value our employees and understand how you... 

NOV

Cybersecurity IAM Engineer Job at NOV

 ...As an IAM Engineer, you'll go beyond processing tickets-you'll build automations, optimize SSO and federation integrations, enforce policy controls through scripting, and work with cross-functional teams to secure identity lifecycles across IT and OT environments. Come... 

Northeast Healthcare Recruitment, Inc.

Neurology Physician Job at Northeast Healthcare Recruitment, Inc.

 ...clinical autonomy, and meaningful patientrelationships.Position HighlightsFull-Time: 44.5 days per weekOutpatient General NeurologyPatient population: Adolescents age 16+ and adultsNew and established patientsBroad spectrum of general neurologyOn-...