IT Recruiter
GCP Data Engineer
- Atlanta GA
Preferred Qualifications
- Candidate must be located within commuting distance of Atlanta, GA or be willing to relocate to the area.
- Bachelor’s Degree or foreign equivalent, will consider work experience in lieu of a degree
- 7+ years of experience with Information Technology and Data engineering.
- 3+ years of experience in Big Data on Big Data, Python, Scala, Spark
- Over 2+ years of experience as data engineer working on cloud based data lakes.
- Experience on developing and supporting applications deployed in GCP (DataProc, Dataflow, Composer, Big Query, BigTable, GCS and various operators in DAG).
- Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and data mart developments.
- Strong knowledge and hands-on experience in SQL, Unix shell scripting
- Knowledge and experience with full SDLC lifecycle
- Experience with Lean / Agile development methodologies
- 4+ years of experience in software development life cycle
- 4+ years of experience in Project life cycle activities on development and maintenance projects
- Experience in Developing and supporting databases and related ETL (batch and real time processing). 3+ years of Experience in developing and supporting Hadoop systems / ETL pipelines.
- Good understanding of Data integration, Data Quality and data architecture
- Hands on knowledge of Google Cloud Platform on GCS, Bigtable, BigQuery
- Proficient in a Scala, Python programming for building and automating data pipelines
- Experience in building streaming pipelines using Kafka
- Experience with Java, Customer Data Platform products or In house implementations and TDD Test Driven Development.
- Good expertise in impact analysis due to changes or issues
- Experience in preparing test scripts and test cases to validate data and maintaining data quality
- Pre and post validation of data, strong skills in data validation frameworks, reconciliation of large data set between different systems
- Strong understanding and hands-on programming/scripting experience skills – UNIX shell, Perl, and JavaScript
- Hands-on development, with a willingness to troubleshoot and solve complex problems
- Good to have knowledge on container technology such as Docker, and Kubernetes
- Good to have knowledge on build management and CI/CD tools (Concourse, Jenkins), and monitoring tools (App Dynamics, etc.)
- Good knowledge on Airflow orchestration and preparing DAGs
- Ability to work in team in diverse/ multiple stakeholder environment
- Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams
- Experience managing team size of 2-3 would be a plusExcellent verbal and written communication skills
- Experience and desire to work in a Global delivery environment
Share with your friends
Apply Now
IT Recruiter
- Calgary, AB
Preferred Qualifications
- Proficiency in English, Spanish & Basic computer knowledge required.
- Dynamic/ Go getter/ Smart/ Energetic / Good Attitude/ willing to learn.
- Human Resources Administrative Assistant Job Duties: Provides job candidates by screening, interviewing, and testing applicants; notifying existing staff of internal opportunities; maintaining personnel records
- Good user knowledge in Google Workspace
- Must have good interpersonal skills.
Share with your friends