Cloud / Data Lake Engineer at JPMorgan Chase Bank, N.A. (Columbus, OH)
Location: Columbus, OH
Type: Full Time
Created: 2021-09-11 05:01:19
The Finance and Risk Warehouse is an organization within JP Morgan's Corporate Technology group responsible for acquiring and integrating data from various product systems within the bank into a single data lake serving the Finance & Risk consumers, including Liquidity Risk, Interest Rate Risk, Credit Risk, and International Regulatory Reporting.
The team constantly strives to use cutting edge technology in delivering optimal business solutions keeping up with the rapidly evolving tech world of today. This makes the role of senior data integration architects and leads extremely critical to the organization. The role of the data integration developer is of paramount importance to ensure that business requirements are met and that modern technologies are employed to create efficient and maintainable features.
As a member of our Software Engineering Group, we look first and foremost for people who are passionate around solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
A data integration developer is responsible for the following key areas: * Development of data integration pipelines sourcing financial and ledger data from various systems within the bank into a data lake * Creation of ETL Data Pipeline processes to validate, enrich and persist data * Build modern software solutions geared towards solving the key business requirements of the organization * Adopt cutting edge technologies such as cloud/containers as a part of application evolution and modernization * Understand business requirements and collaborate with the architecture team to translate them into technical design * Demonstrate the ability to work in an Agile SDLC environment and constantly strive towards improving the practices within the organization
Ideal candidates should possess: * Basic concepts of data integration architecture * Basic understanding of data modeling concepts * In depth grasp of various components of standard ETL Data Pipeline tools (preferably Ab Initio) * Extensive design and development experience with data integration solutions using an ETL tool (preferably Ab Initio) * Prior experience in working with data pipelines in a cloud or Kubernetes environment * Working knowledge of Oracle, especially relating to PL/SQL * Understanding of Big data technologies including but not limited to Spark, Hadoop, Hive, Impala and HBase * Hands-on experience with understanding Spark processing and debugging graphs and logs * Demonstrable knowledge of UNIX operating systems and shell scripting * Working knowledge of scheduling tools such as Control-M, Autosys * Strong grasp on SDLC concepts including development best practices, code migration procedures and test automation * Ability to work in an Agile development environment against challenging project timelines * BS/BA degree or equivalent experience
Additionally, an understanding of at least some of these technologies and practices is beneficial: * Knowledge of test automation frameworks such as Cucumber * Working knowledge of Kafka as a distributed publish-subscribe system * Experience with modern big data consumption technologies such as Dremio * Working knowledge of Python, Java and Scala * Modern web technologies such as NodeJS, AngularJS, React, Redux, or Typescript * Understanding of modern cyber security practices such as Kerberos authentication
JPMorgan Chase & Co., one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. In accordance with applicable law, we make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as any mental health or physical disability needs.
Equal Opportunity Employer/Disability/Veterans