Senior Data Engineer Job at C&G Consulting Services, Inc, Jupiter, FL

Zm9TSlkza1luVzNuTDkvcnd6UUljNTJGQXc9PQ==
  • C&G Consulting Services, Inc
  • Jupiter, FL

Job Description

This is a Full Time Sr. Data Engineer/ Architect position. Open to relocation. Potential hybrid situation.

Job Description:

  1. Collaborate effectively with Stakeholders, Project Managers, Software Engineers, Data Analysts, QA Analysts, DBAs, and Data Engineers
  2. Build and maintain data pipelines based on functional and non-functional requirements
  3. Proactively seek out information and overcome obstacles to deliver projects efficiently
  4. Ensure that data pipelines incorporate best practices related to performance, scaling, extensibility, fault tolerance, instrumentation, and maintainability
  5. Ensure that data pipelines are kept simple and not overly engineered
  6. Produce and maintain design and operational documentation
  7. Analyze complex data problems and engineer elegant solutions
  8. Stay abreast of emerging technologies and make relevant recommendations
  9. Upgrade existing data models and pipelines leveraging newer features and techniques
  10. Work in a Kanban environment
  11. Mentor less experienced data engineers
  12. Participate in engineering standards and best practices evolution
  13. Participate in an on-call rotation
  14. Lead investigations to troubleshoot pipeline issues

Minimum Requirements

10+ years with hands-on data engineering and deep knowledge of data architecture fundamentals including:

  1. Extensive experience building ETL/ELT pipelines from a variety of data sources
  2. Broad experience with database and associated technologies for moving and storage of data
  3. Experience evaluating and selecting tools and technologies based on fitness for purpose and stakeholder requirements
  4. Deep knowledge and experience with concepts such as performance tuning, execution plan analysis, and index optimization in at least one database technology (e.g., T-SQL, PL-SQL, NoSQL, etc.)
  5. Extensive experience creating and maintaining a wide variety of database objects including, tables, views, functions, stored procedures, etc.
  6. Comprehensive experience with data modeling indexes, temporal tables, CLR, etc.
  7. Deep understanding of the development of data pipelines using multiple external data sources and transport mechanisms
  8. Strong initiative, collaboration, accountability, impartiality, and communication
  9. Strong analytical skills, a real passion for working with data and strong interest in solving data problems
  10. Strong track record for judging core requirements and meeting deadlines
  11. Experience managing master data
  12. Experience writing C#, PowerShell, and Python
  13. Experience with Git source control
  14. Experience working in a Kanban SDLC and a strong understanding of traditional Kanban SDLC workflows
  15. Experience with deploying changes through segregated Development, QA, UAT and Production SDLC stages
  16. Experience owning mission-critical processes
  17. Bachelor’s degree in Computer Science, Information Systems, or related disciplines
  18. Ability to work onsite in our Jupiter, FL office

Preferred Skills and Previous Experience

  1. Python programming using libraries such as Pandas, Numpy, csv, Traceback, JSON, PyODBC, Math
  2. Experience with source code branching and pull requests / code reviews
  3. Experience with AWS
  4. Experience working with clinical and/or consumer healthcare data
  5. Experience with tools such as Red Gate, Grafana, OpsGenie and JAMS
  6. MS/PhD in Computer Science, Information Systems, or related disciplines

Job Tags

Full time, Relocation,

Similar Jobs

The Hunter Group Associates

Sous Chef Job at The Hunter Group Associates

Want to cook great food and still have a life? We're searching for a Chef at the corporate headquarters of a global company. All-scratch, as local and sustainable as possible food program. Great benefits and growth!

AVIRE

Technical Support Specialist Job at AVIRE

 ...growing our business together? If you have answered yes to these questions, we should connect...  ...of Inside Sales Specialists, Customer Service Specialists, Application Support Technicians...  .... Benefits Competitive base salary Participation in the company bonus... 

Pentangle Tech Services | P5 Group

Senior Software Engineer Job at Pentangle Tech Services | P5 Group

 ...Job Description We are seeking a highly skilled Senior Software Engineer to develop innovative software solutions that automate product manufacturing, laboratory testing, SQL data storage, and data analysis in a dynamic, customer-focused automotive environment. Responsibilities... 

Afterkarma Inc

Business Analyst Job at Afterkarma Inc

 ...Business Analyst Banking (W2, $20-30/hr) Location: Hybrid, NYC Job Type: Contract W2 Rate: $ 20-30/hr &##1...  ...tocorp) Pay Rate: $20-30 per hour Location: Open to fully remote or onsite in select U.S. offices Contract Duration: TBD (with... 

Covetus

SAP Consultant Job at Covetus

 ...USC and GC Ability to review data profiling results and define data quality metrics with business Understanding of master data and SAP data structures Experience facilitating business discussions to define data quality rules (e.g., for customer, material, supplier, assets...