Senior Data Engineer Job at aKUBE, Dallas, TX

QUhWNkx4aExJdXVaUkM5NG1wQkxCdlgvY1E9PQ==
  • aKUBE
  • Dallas, TX

Job Description

City: Las Vegas, NV or Dallas, TX or Atlanta, GA

Onsite/ Hybrid/ Remote: Onsite

Work Authorization: US Citizens ONLY

Fulltime

Client is seeking a highly skilled Senior Data Engineer to fill a full-time role for our client. The Senior Data Engineer is responsible for designing, building, and managing robust data platforms and tools to enable efficient processing and analysis of large-scale data. This role involves developing and maintaining scalable data pipelines, ensuring data quality, and deploying machine learning models into production. The position requires close collaboration with business teams to enhance data models for business intelligence tools, driving accessibility and fostering data-driven decisions across the organization. Responsibilities include creating real-time and batch pipelines to handle high data volumes and translating business requirements into scalable data solutions through collaboration with cross-functional teams.

MUST Have:

  • Expertise in Python, SQL and CI/CD practices.
  • Hands-on experience with Databricks, Spark, and Fabric or equivalent tools.
  • Experience in data migration using Azure services

Key Responsibilities

  • Design, develop, and maintain real-time and batch data pipelines to process and analyze large datasets efficiently.
  • Create and maintain tools to ingest, curate, and provision first-party and third-party data for analytics, reporting, and data science.
  • Develop advanced data products and intelligent APIs while monitoring system performance, troubleshooting, and integrating new features.
  • Analyze data and design architecture to support business intelligence, AI/ML, and data products.
  • Implement data platform architectures that meet analytical requirements, emphasizing scalability, maintainability, and flexibility.
  • Provide technical leadership, mentoring, and code reviews, with a focus on test-driven development and CI/CD practices.

Qualifications

Experience

  • 8+ years of experience as a data engineer with full-stack capabilities.
  • 10+ years of programming experience.
  • 5+ years of experience in cloud technologies (Azure, AWS, or Google Cloud).
  • Expertise in Python, SQL and CI/CD practices.
  • Hands-on experience with Databricks, Spark, and Fabric or equivalent tools.
  • Proficiency in designing and developing data ingestion, processing, and analytical pipelines for big data, NoSQL, and data warehouses.
  • Experience in data migration using Azure services (e.g., ADLS, Azure Data Factory, Event Hub, Databricks).
  • Advanced knowledge of big data and streaming technologies (e.g., Apache Spark, Kafka).

Skills

  • Strong understanding of data architecture, data modeling, and data security best practices.
  • Proficiency with BI tools like Power BI and Tableau.
  • Knowledge of developing intelligent applications and APIs.
  • Experience with RESTful APIs and messaging systems.
  • Critical thinking, problem-solving, and process improvement abilities.
  • Strong organizational and communication skills to work effectively in dynamic, fast-paced environments.

Preferred Skills

  • Experience with machine learning and ML pipelines.
  • Familiarity with Agile methodologies.
  • Proven ability to create technical documentation and deliver impactful presentations.

Education

  • Bachelor’s degree in Computer Science, Information Systems, Data Science, Engineering, or a related field (required).
  • Master’s degree in a relevant field (preferred).

Compensation & Benefits:

  • Base pay: 150k to 175k Dependent on experience
  • +Bonus, Vacation, Medical etc.

Job Tags

Full time, Remote work,

Similar Jobs

Eliassen Group

Recruiting Associate Job at Eliassen Group

 ...impacts the lives of our employees, clients, consultants, and the communities in which we operate. ~2023 Best Managed Companies by Deloitte and Wall Street Journal ~ ClearlyRated 2023 Best of Staffing , Client, and Talent 5-year Diamond Award for Service Excellence... 

Hays

General Superintendent - Highway/Bridge Construction Job at Hays

 ...have a minimum of 10 years of experience in building highways, bridges, or large-scale TxDOT projects.. This role offers the...  ...Key Responsibilities: Oversee and manage all aspects of construction projects, ensuring they are completed on time, within budget,... 

BRT, Inc.

CDL Class A Regional Tanker Truck Driver Job at BRT, Inc.

 ...BRT, Inc. is a family-owned carrier, currently seeking REGIONAL Class A Full-Time Tank/Haz Drivers for liquid bulk petroleum deliveries based out of the greater Wheeling, WV area. Learn about our culture: See our new equipment: Call or Text with questions: Jean... 

Insight Global

Product Designer Job at Insight Global

 ...Position: Product Designer Location : Dearborn, MI (Hybrid, 1 day per week onsite) Duration: 24 month contract Pay Range: $46.75/hr - $57/hr Day to Day: The role involves designing intuitive and engaging user business process experiences for timekeeping... 

Spectrum Staffing Services/HRStaffers Inc.

Environment, Health and Safety Manager Job at Spectrum Staffing Services/HRStaffers Inc.

 ...Looking for an exciting opportunity to lead environmental health and safety (EHS) initiatives while managing a dynamic facility? A cutting-edge technology and innovation center is seeking a proactive EHS and Facilities Manager to oversee daily operations, ensure safety...