2 PDI TECHNOLOGIES JOBS

We are hiring for Database EngineerRole: Database Engineer IIIExperience: 7+ YearsLocation: ChennaiAvailability: Immediate to 15 daysSkills & Abilities:• At least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database,Data warehousing & basic-level administration of data infrastructure• At least 7 years coding experience in Java, Python, R or other equivalent programminglanguage• At least 4 years big data experience• At least 2 years’ experience as technical lead architecting data lake/data warehouse/lakehouse systems & mentoring team of Data Engineers / DBAs• Design, Development & implementation of OLTP & OLAP databases with efficient design,optimization techniques & data ingestion mechanisms.• Proficient in Python, SQL and PL-SQL, query tuning, optimization, ETL, ELT, Data Modelingand Data Warehouse systems.• Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc.,handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg• Experience building data lakes & warehouse systems leveraging cloud environmentsincluding AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloudwatch, & EMR• Experience with data orchestration tools like Airflow• Experience in building pipelines, ingesting data from heterogeneous systems onto datalake environments in real time• Proficient in Business Intelligence (BI), analytic database and products, able to takebusiness requirements and translate into database tables, pipeline design and tasks.• General data-specific concepts, frameworks and processes• Agile development practices• Working within an SDLC• Designing data warehouses including definition, structure, documentation, maintenance,long-range requirements, operational guidelines, and protection• Data governance, meta data management, data security measures, retention & archivalacross data lake layers.

The OpportunitySeize the opportunity to become a technical expert -Data Engineer responsible for designing, building, and maintaining the infrastructure needed to handle large volumes of data and work with various tools and technologies to develop solutions that enable our organization to process, analyze, and derive insights from massive datasets.Primary Responsibilities • Utilize architectural and design skills for a variety of data-oriented tasks. • Establish and maintain strong relationships with business stakeholders. • Build highly reliable & scalable data systems with good data governance that provide complete, secure, accurate and timely data for analytics. • Expertise in data & dimensional modeling with good business acumen in supporting new product features and services - including financial reporting. • Assist development and analytics organization to meet its delivery goals with regards to data design, flow and infrastructure. • Perform Data Modeling, Big data architecture design, support and implementation of OLTP, real time OLAP/data warehouse systems and ETL pipelines.• Track/Build & monitor data/system KPI’s like storage, performance & usage • Hands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniqueKnowledge, Skills & Abilities • At least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database, Data warehousing & basic-level administration of data infrastructure • At least 7 years coding experience in Java, Python, R or other equivalent programming language • At least 4 years big data experience • At least 2 years’ experience as technical lead architecting data lake/data warehouse/lake house systems & mentoring team of Data Engineers / DBAs • Design, Development & implementation of OLTP & OLAP databases with efficient design, optimization techniques & data ingestion mechanisms. • Proficient in Python, SQL and PL-SQL, query tuning, optimization, ETL, ELT, Data Modeling and Data Warehouse systems. • Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc., handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg • Experience building data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR • Experience with data orchestration tools like Airflow • Experience in building pipelines, ingesting data from heterogeneous systems onto data lake environments in real time • Proficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database tables, pipeline design and tasks. • General data-specific concepts, frameworks and processes • Agile development practices • Working within an SDLC