Cloud Data Engineer Or Big Data Engineer for Dallas, TX

Hello,

Hope you’re doing well, please have a look at the below JD & revert back if interested.

Cloud Data Engineer/Big Data Engineer having experience with data integration development using Python/Java.

Dallas, TX

Experience

• 7-10 years of increasingly responsible systems development experience on multiple platforms.

• A minimum of 6 years’ experience in the development environment commensurate with the assigned area of responsibility.

• A minimum of 2 year experience with Google Cloud Platform(GCP) environment

Essential Skills

• Experience with using core Python - Methods, Functions, Iterators, Generators, Exception Handling, File handling concepts, OOPs Concepts and Data Structures

• Experience with the GCP Cloud Composer(Airflow), Cloud Dataflow and BigQuery

• Proficient in writing scripts in Python for data extraction and data transfer from various data sources.

• Expertise in understanding the entire python eco-system

• Experience of invoking REST APIs with Python to develop extensible solutions for data acquisition and data integration, according to requirements of the business.

• Experience using jinja templates with Python

• Analyze/creation of various type of raw file like Json, Csv, Xml with Python using Pandas, Numpy etc.

• Knowledge and implementation experience with Java with primary focus on building the integration services with message brokers like Kafka

• Knowledge and experience to use code versioning tools such as Git, Bitbucket etc.

• Experience with databases, PostgreSQL preferred; Oracle, SQLServer are also acceptable

• Ability to track record of designing and developing high quality, scalable and efficient solutions and products on schedule.

• Team player and individual contributor.

• Ability to accurately identify root cause of technical problems.

Thanks & Regards

Avinash Kumar

Sr. US IT Recruiter

Desk: 408-418-5778 Ext 3009

Direct: 408-777-6480

Email: avinash.k1@idctechnologies.com