Sr. Data Engineer – Remote

education

The Senior Information Designer will assume a crucial part in creating and supporting changes and expansions to our Arranging task’s information extraction, mistake recognizable proof, and change processes. This job incorporates guaranteeing the respectability and exactness of information stacking, checking progress, detailing mistakes, and remedying information ingestion/approval issues. Obligations likewise incorporate moving verifiable information from heritage Iseries frameworks to Purplish blue or Google Cloud, setting up and designing information network, and overseeing information planning between frameworks. Brilliant relational abilities are required.

Obligations:
Information Extraction and Change:

Create and uphold adjustments/augmentations to the venture’s source information extraction processes.
Recognize and determine source information mistakes and change issues.
Support the stacking of information and guarantee precise advancement observing and blunder announcing
Information The executives Backing:

Offer help to information the executives drives through information models, information controls, and joining abilities.
Use information on Peaceful APIs and combination procedures to upgrade information coordination processes.
Comprehend and work with various data set stages, including Prophet, SQL Server (Purplish blue) and DB2.
Create and keep up with viable KPIs to oversee information honesty, and SLA adherence
Execution Streamlining and Versatility arranging:

Tuning and streamlining information handling pipelines and frameworks for further developed execution.
Observing and tending to bottlenecks in information work processes.
Helping with making arrangements for future information development by planning adaptable arrangements.

Organization:

Set up and design information availability and oversee information mappings between the host frameworks and the new arranging instrument.
Use SDLC processes for Information and Applications including Cascade, Lithe and DevOps

Prerequisites::

Four year college education in Software engineering, Data Innovation, or Information Science
7+ years’ ever-evolving experience as an Information Specialist
Capability in working with different data set stages, including Prophet, SQL Server (On-Prem/Sky blue) and DB2
Solid SQL abilities and involvement in data set administration.
Capability in programming dialects utilized for information designing (e.g., Python, Java, Scala). Capacity to compose scripts for information control, change, and robotization.
Solid information on information administration, information approval, and information quality improvement rehearses. Experience with Information administration devices like Dataplex is an or more.
Experience with cloud-based information administrations and stages, explicitly Sky blue and Snowflake.
Solid information on information pipeline advancement, ETL cycles, and information reconciliation.
Experience working with Programming interface designers to associate and coordinate frameworks.
Knowledge of Relaxing APIs and mix procedures.
Experience with huge information innovations like Kafka

About Korn Ship

Korn Ship releases possible in individuals, groups, and associations. We work with our clients to plan ideal association designs, jobs, and obligations. We assist them with recruiting the ideal individuals and encourage them on the most proficient method to remunerate and inspire their labor force while creating experts as they explore and propel their professions.