GDS Consulting_DATA - Azure Databricks - Senior

pspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0pxAt EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. /span/span/pp /pp /pp /pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptWe’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongYour key responsibilities/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptDevelop amp; deploy Azure Databricks in a cloud environment using Azure Cloud services/spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptConfigure and replicate the Azure Databricks platform, including workspaces, clusters, and storage based on existing Hadoop workloads./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptMigration of Hadoop jobs (YARN, SPARK), ETL workflows (Sqoop scripts, Hive), Kafka streams, Impala queries and database objects to Azure Databricks, ensuring efficient data cleaning, transformation, and loading./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptSet up and manage workflow orchestration using Databricks Jobs Scheduler, handling dependencies and scheduling of data processing tasks./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptImplement monitoring solutions to track the health and performance of the Databricks environment, configuring alerting mechanisms for proactive issue resolution./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptEnsure all code is maintained in the existing Git repository, undergoing peer reviews to maintain quality and readability./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptConduct System Integration Testing (SIT) and QA testing parallel to development, ensuring all critical workflows and reports function correctly./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptDocument and address any issues identified during testing, compiling detailed reports for stakeholders./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptImplement the cutover strategy and production migration according to the deployment plan, communicating with stakeholders and ensuring non-restricted hours migration./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptImplement data validation checks to confirm the integrity and completeness of the migrated data./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptDocument the deployment process, including encountered issues and their resolutions, and provide stakeholders with information on how to report any issues./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptProvide hyper care support post-deployment, addressing any issues promptly and transitioning to standard operational support as the environment stabilizes. /span/li/ulpspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt   /span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongSkills and attributes for success/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt3 to 7 years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExtensive hands-on experience implementing data migration and data processing using Azure services: Databricks (notebooks, workspaces, delta lake, clusters), ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Event Hubs etc./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptHands on experience in programming like python/pyspark/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptNeed to have good knowledge on DWH concepts and implementation knowledge in ACID transactions/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptWell versed in DevOps and CI/CD deployments/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptMust have hands on experience in SQL and procedural SQL languages/spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptStrong analytical skills and enjoys solving complex technical problems/span/li/ulpspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongTo qualify for the role, you must have/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptBe a computer science graduate or equivalent with 3 to 7years of industry experience/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptHave working experience in an Agile base delivery methodology (Preferable)/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptFlexible and proactive/self-motivated working style with strong personal ownership of problem resolution./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptStrong analytical skills and enjoys solving complex technical problems/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptProficiency in Software Development Best Practices /span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExcellent debugging and optimization skills/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExperience in Enterprise grade solution implementations amp; in converting business problems/challenges to technical solutions/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptconsidering security, performance, scalability etc/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExcellent communicator (written and verbal formal and informal)./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptParticipate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support. /span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptClient management skills/span/li/ulp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongIdeally, you’ll also have/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExperience on HealthCare domains/span/li/ulp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongSkills and attributes for success/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptUse an issue-based approach to deliver growth, market and portfolio strategy engagements for corporates/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptStrong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptExperience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint. /span/li/ulpspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongWhat we look for/strong/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptA Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptAn opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide./span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptOpportunities to work with EY Advisory practices globally with leading businesses across a range of industries/span/li/ulpspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptstrongWhat working at EY offers/strong/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptAt EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptYou get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:/span/pulli style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptSupport, coaching and feedback from some of the most engaging colleagues around/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptOpportunities to develop new skills and progress your career/span/lili style=font-family:arial, helvetica, sans-serif;font-size:10.0ptspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptThe freedom and flexibility to handle your role in a way that’s right for you/span/li/ulp /pp /ppspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0pxbEY | Building a better working world /b/span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brEY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  /span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brEnabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  /span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brWorking across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.  /span/span/p