Job title: Lead Big Data Engineer (GCP Cloud)
Location: Irving, TX
Duration: Long-term
Skills Needed:
10+ years of experience in designing and building data pipelines in large-scale distributed systems.
Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines.
Proficiency with Google Cloud Platform (GCP) and tools such as BigQuery, Dataflow, Pub/Sub, GCS.
Strong experience with the Hadoop Big Data Ecosystem: HDFS, Hive, Pig, HBase, YARN, and others.
Proficiency in Python and Scala for data engineering and scripting.
In-depth knowledge of SQL for data manipulation, transformation, and analysis.
Experience building both batch and real-time streaming data pipelines
Solid understanding of Hadoop fundamental concepts
Strong familiarity with CI/CD pipelines
Excellent problem-solving skills with an ability to troubleshoot complex data systems and performance bottlenecks.
Proven ability to lead and mentor teams of engineers, driving the development of cutting-edge data solutions.
...Job Description Lexington Center, the largest provider of outpatient and residential substance use disorder services in the Hudson Valley, is seeking full-time substance abuse counselors for its Poughkeepsie Clinics in Dutchess Counties. Duties include intake, individual...
Replies within 24 hours Estas buscando empleo de limpieza de casas? Si te gusta limpiar y ver todo ordenado este empleo te interesar.!! Trabajas para nosotros y pagamos $15 - $16 por hora de limpieza!!! No se trabaja de noche, en ocaciones de manera voluntaria...
...delivered across a system of 140 hospitals and more than 2,200 care centers serving 24 states.As Director of Security for Executive Protection at CommonSpirit Health you will independently execute a security management plan that would ensure the safety and transportation...
Overview: Its a new day for career opportunities at Sonrava - so join us and get on board LOCUMS POSITION -TRAVELLING DENTIST IN DFW AREA This is a fantastic opportunity for the right clinician. Join a team of quality-orientated professionals that you will be...
...Job Title: Material Specialist Location: Waterloo, IA Duration: 12+ Months Contract on W-2 (High Probability the role will go longer) 1st shift position Hours: 6 AM to 2:30 PM with possible overtime. Note: Overtime may include extended weekday hours or...