Data Engineer (Python + Azure Databricks + SQL Job at Diverse Lynx, Hartford, CT

L3ZGakZNV012cjhkNUl1ZXFDNTROQ0ttdlE9PQ==
  • Diverse Lynx
  • Hartford, CT

Job Description

Position: Data Engineer ( Python + Azure Databricks + SQL) Location: Hartford, CT/Stamford, CT- Day 1 Onsite Position Type: Contract This position will see you responsible for liaising with the business to gather requirements, working with the team to identify potential tools and through the migration on to a centralized platform consolidate data sources. Roles and Responsibilities:

  • Analyses current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics Services.
  • Engage and collaborate with customers to understand business requirements/use cases and translate them into detailed technical specifications.
  • Experience with Python/Pyspark frameworks/libraries.
  • Expertise of Azure Databricks.
  • Experienced of SQL.
  • Experience in designing and implementing complex ETL and process flows
  • Expertise across data transformation frameworks.
  • Good to have Azure/Azure DevOps knowledge.
  • Configuration Management, CI/CD and Cloud
  • Develop best practices including reusable code, libraries, patterns, and consumable frameworks for cloud-based data warehousing and ETL.
  • Maintain best practice standards for the development or cloud-based data warehouse solutioning including naming standard
Experience:
  • Good understanding of the platform and the code/integration behind.
  • Want to upgrade the system to be the most efficient version.
  • 5-7 years of experience in a Data Engineer role.
  • Strong knowledge in data modeling, data warehousing, and ETL processes.
  • Strong knowledge of database management systems (e.g., SQL Server, Oracle, MySQL).
  • Experience with Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and other Azure data services.
  • Familiarity with data governance, data quality, and data security best practices.
  • Experience with DevOps practices, agile methodologies, and collaboration tools.
Key Skills Required:
  • Python + Azure Databricks + SQL
  • Experience in designing and hands-on development in cloud-based analytics solutions.
  • Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
  • Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
  • Experience in developing NO SQL solutions using Azure Cosmos DB is essential.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. Diverse Lynx

Job Tags

Contract work,

Similar Jobs

Andiland Adventures

Independent Virtual Travel Agent - Work From Home Job at Andiland Adventures

Were looking for a travel advisor with experience selling travel but not required! This job is a great position for an individual who loves working in a fast-paced environment, maximizing their earning potential, and loves to travel! Responsibilities: *Work with... 

Baylor Scott & White Health

Acute Care/Trauma Surgeon Job at Baylor Scott & White Health

Acute Care/Trauma Surgeon Job Opportunity in Irving, TexasBaylor Scott & White Health is seeking a Board Certified/Board Eligible General Surgeon to help expand our Acute Care and Trauma Surgery service line in Irving, Texas. This is an employed career opportunity with... 

Jobs for Humanity

Compliance Operations Associate Job at Jobs for Humanity

 ...Compliance Operations Associate This is an apprenticeship opportunity. This is a hybrid role in New York NY. About this Position You will support the Consumer Deposit Product Operations team ensuring our Checking Savings and IRA products meet operational... 

Kaplan

Student Content Creator - Arizona State University - Polytechnic Campus Job at Kaplan

Job TitleStudent Content Creator - Arizona State University - Polytechnic Campus Job Description Who we are Through Kaplan International...  ...student recruitment. The role We are looking for a creative and motivated Student Content Creator to join our team. In... 

Medsurg Sales Staffing

Surgical Sales California Entry Level 150k Job at Medsurg Sales Staffing

Blue chip medical device manufacturer is looking to fill a sales position. All work related expenses are covered by the company. Extensive...  ...a sales associate at a medical or surgical company. * 2yrs pharmaceutical or medical sales experience with a prior background in BtoB...