Data Engineer with Databricks Developer (W2 Position)
Location: Washington, DC
Duration: 6+ Months
Job description :
Need 10+ years of experience as a Data Engineer
Databricks & AWS Big Data Architecture Certification would be plus.
Solid experience with SQL-based database is required.
Two-year experience with Hadoop/Spark in either an administrative, development or support role is required.
Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes.
Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data
Must have excellent coding skills either Python or Scala.
Must have experience in Data Engineering domain.
Must have implemented at least 2 project end-to-end in Databricks.
Must have experience on Databricks which consists of various components as below.
Delta lake
dbConnect
db API 2.0
Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept, Medallion architecture and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Preferred Qualifications/Skills
Good to have Unity catalog and basic governance knowledge.
Good to have MicroStrategy or Tableau reporting experience.
Good to have knowledge of docker and Kubernetes.
Good to have Linux/Unix Admin or development skills.
Please share profile's to sudheer@anveta.com
...Job Description: Production Assistant Fortunate Son Wines Fortunate Son Wines is looking for a full-time Production Assistant. The person must be able to work independently and efficiently at multiple locations alongside the Production Manager. Must have strong...
We are looking to add an upbeat Front Desk Agent to their team to manage all aspects of hotel guests accommodation. You will welcome new guests and... ...This position will be required to work any shift needed ie AM, PM, or Night Audit. ***Weekends will be required; This will...
...per week in taxable pay and non-taxable stipends~ Specialty: RN ~ Start Date: 8/2/2024~ Duration: 13~36 hours per week... ...Type: Traveler Ardor Health Solutions is looking for a Outpatient Surgery - SDS to join our travel team in Oklahoma City, OK! This is a...
...RN Primary Care Nurse PACE Full-time, Benefit Eligible Revere, MA Sign-On Bonus... ...Responsible for the general oversight, assessment, planning, and construction of the... ...vision coverage. ~ Life and disability insurance. ~401(k) retirement plan. ~ Tuition reimbursement...
...Buyer Working Hours/Shift: M-F; flexible - with some overlap, EST Salary Range: $ 800-1200 USD Overview: The Buyer will procure items for various departments and teams and liaise with suppliers considering multiple factors before placing orders. The Buyer...