You’re being taken to an external site to apply.
Enter your email below to receive job recommendations for similar positions.PROCESSING APPLICATION
Hold tight! We’re comparing your resume to the job requirements…
ARE YOU SURE YOU WANT TO APPLY TO THIS JOB?
Based on your Resume, it doesn't look like you meet the requirements from the employer. You can still apply if you think you’re a fit.
Job Requirements of Data Engineer_Pan India:
-
Employment Type:
Full-Time
-
Experience:
Not Specified
-
Education:
Not Specified
-
Travel:
Not Specified
-
Manage Others:
Not Specified
-
Location:
Gurugram, Haryana (Onsite)
Do you meet the requirements for this job?
Data Engineer_Pan India
Primary Skill:
• Minimum 5 years of Big Data experience in Big data ecosystem
• Spark (either Pyspark or Scala, customer is open to both languages)
• Hive
• Experience in data ingestions using spark, data processing, bucketing, partitioning
JD:
Ability to clean, aggregate, and organize data from disparate sources and transfer it to data Azure data lake for the Data Consumer or Data Scientist to consume.
o Must to Have:
- Data Transformation / Processing: Spark (Either PySpark or Scala)
• Transform data using techniques such as filtering, grouping, and aggregation to translate raw data into analysis-ready datasets.
- Scripting: Python for Data.
- Query: PL/SQL, HIVE
o Good to Have:
- Ingest: Informatica (Powercenter should be good enough)
- Processing: Databricks Spark Engine and Databricks DB.
- Storage: Azure Data Storage such as Blob, ADLS Gen2
- Data Scheduling: Airflow
- Visualization: Tableau
- Knowledge of Data Governance, CICD
Recommended Skills
- Apache Hive
- Apache Spark
- Big Data
- Data Processing
- Pyspark
- Scala (Programming Language)
Help us improve CareerBuilder by providing feedback about this job:
Job ID: 14706503
CareerBuilder TIP
For your privacy and protection, when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction. Learn more.
By applying to a job using CareerBuilder you are agreeing to comply with and be subject to the CareerBuilder Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.