Senior GCP Data Engineer

Company: Cat Software Services Inc.
Location: Irving
Posted on: November 16, 2024

Job Description:

Hi,

Do you have the following skills, experience and drive to succeed in this role Find out below.

I hope you are doing Well. Please review the position below and let me know if you can take it. As soon as possible, please send me your most updated resume in Word with your contact details so we can talk further.

Job Title: GCP Data Engineer

Location: Irving, TX (Onsite)

Project Duration: 12 months Contract

Relocation available from Day 1



The ideal candidate will have strong Streaming experience and Dataflow with Java experience

how to create a Dataflow pipeline using Java via google cloud


Keyword Phrases:

"Designed and implemented Dataflow pipelines using Java"
"Optimized Dataflow pipelines for performance and cost-efficiency"
"Integrated Google Cloud Dataflow with BigQuery"
"Developed robust error handling in Dataflow pipelines"
"Transformed data using Apache Beam and Dataflow"
"Ensured data quality in ETL pipelines on GCP"


What the Client is looking for:

Hadoop + GCP Sr. Engineer
Kafka Streaming - Partitions, topics, consumer groups does he work or not
Hive Queries to point external tables
Oozie scheduling and GCP Airflow scheduling
Hadoop configurations like admin activities
Spark streaming jobs,
GCP pub-sub and subscriptions
GCP data flow custom template creation


Job Description:

Should have GCP Cloud Experience.

Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation

ETL development experience with a strong SQL background, analyzing huge data sets, trends, and issues, and creating structured outputs.

Experience in building high-performing data processing frameworks leveraging Google Cloud Platform.

Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation, and aggregation.

Experience in utilizing GCP Services like Big Query, Airflow, Cloud Composer, Dataflow, Pub-Sub, Cloud Monitoring, and Data Proc.

Understand ETL application design, data sources, data targets, relationships, and business rules.




Skills:
Years of Exp
Rating out of 10 scale
GCP


GCP Big Query


Airflow


Data-proc


GCP Pub-sub


GCP Dataflow


Composer


Python


Batch streaming


Apache Spark


Real-time Data & Kafka


Hadoop


Hive Queries


Oozie scheduling


Java


Scala





Best Regards,

Saad - IT Recruiter

CAT Software Services INC.

PH.NO: 848-300-3501

Email: saad.m@cssitconsulting.com

Linked.in: http://linkedin.com/in/mohammed-sadullah-108b22267

CAT Software Services INC.

5 Independence Way Suite 300, Princeton, NJ, 08540

Website: www.Catsoftwareservices.com

Keywords: Cat Software Services Inc., Dallas , Senior GCP Data Engineer, Engineering , Irving, Texas