GDS Consulting_DATA_Azure Databricks - Senior

pspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0pxAt EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. /span/span/pp /pp /pp /pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptWe’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt /span/ppbrstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptYour key responsibilities/span/strong/pp /ppbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Develop amp; deploy Azure Databricks in a cloud environment using Azure Cloud services/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Configure and replicate the Azure Databricks platform, including workspaces, clusters, and storage based on existing Hadoop workloads./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Migration of Hadoop jobs (YARN, SPARK), ETL workflows (Sqoop scripts, Hive), Kafka streams, Impala queries and database objects to Azure Databricks, ensuring efficient data cleaning, transformation, and loading./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Set up and manage workflow orchestration using Databricks Jobs Scheduler, handling dependencies and scheduling of data processing tasks./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Implement monitoring solutions to track the health and performance of the Databricks environment, configuring alerting mechanisms for proactive issue resolution./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Ensure all code is maintained in the existing Git repository, undergoing peer reviews to maintain quality and readability./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Conduct System Integration Testing (SIT) and QA testing parallel to development, ensuring all critical workflows and reports function correctly./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Document and address any issues identified during testing, compiling detailed reports for stakeholders./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Implement the cutover strategy and production migration according to the deployment plan, communicating with stakeholders and ensuring non-restricted hours migration./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Implement data validation checks to confirm the integrity and completeness of the migrated data./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Document the deployment process, including encountered issues and their resolutions, and provide stakeholders with information on how to report any issues./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Provide hyper care support post-deployment, addressing any issues promptly and transitioning to standard operational support as the environment stabilizes./span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptSkills and attributes for success/span/strong/pp /ppbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    3 to 7 years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks (notebooks, workspaces, delta lake, clusters), ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Event Hubs etc./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Hands on experience in programming like python/pyspark/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Need to have good knowledge on DWH concepts and implementation knowledge in ACID transactions/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Well versed in DevOps and CI/CD deployments/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Must have hands on experience in SQL and procedural SQL languages/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Strong analytical skills and enjoys solving complex technical problems/span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptTo qualify for the role, you must have/span/strong/pp /ppbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Be a computer science graduate or equivalent with 3 to 7years of industry experience/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Have working experience in an Agile base delivery methodology (Preferable)/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Strong analytical skills and enjoys solving complex technical problems/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Proficiency in Software Development Best Practices /span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Excellent debugging and optimization skills/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Experience in Enterprise grade solution implementations amp; in converting business problems/challenges to technical solutions considering security, performance, scalability etc/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Excellent communicator (written and verbal formal and informal)./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support. /span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Client management skills/span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptIdeally, you’ll also have/span/strong/pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Experience on HealthCare domains/span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptSkills and attributes for success/span/strong/pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Use an issue-based approach to deliver growth, market and portfolio strategy engagements for corporates/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Strong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Experience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint. /span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptWhat we look for/span/strong/pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    A Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    An opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide./span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Opportunities to work with EY Advisory practices globally with leading businesses across a range of industries/span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptWhat working at EY offers/span/strong/pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptAt EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are./spanbrspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptYou get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:/span/pp /ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Support, coaching and feedback from some of the most engaging colleagues around/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    Opportunities to develop new skills and progress your career/span/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0pt•    The freedom and flexibility to handle your role in a way that’s right for you/span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptAbout EY/span/strong/ppspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptAs a global leader in assurance, tax, transaction and advisory services, we’re using the finance products, expertise and systems we’ve developed to build a better working world. That starts with a culture that believes in giving you the training, opportunities and creative freedom to make things better. Whenever you join, however long you stay, the exceptional EY experience lasts a lifetime. And with a commitment to hiring and developing the most passionate people, we’ll make our ambition to be the best employer by 2020 a reality./span/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptIf you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible./span/strong/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptJoin us in building a better working world.  /span/strong/pp /ppstrongspan style=font-family:arial, helvetica, sans-serif;font-size:10.0ptApply now/span/strong/pp /ppspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0pxbEY | Building a better working world /b/span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brEY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  /span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brEnabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  /span/span/ppbrspan style=font-family:Arial, Helvetica, sans-serifspan style=font-size:11.0px brWorking across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.  /span/span/p