Job Description

NISC is seeking an experienced Data Engineer to curate and optimize data and data pipeline architecture in Databricks, focusing on data flow and collection for various application teams. The role involves supporting data needs across multiple teams and systems, contributing to a Data Roadmap strategy, and ensuring optimal data delivery architecture.

Responsibilities

• Assemble large, complex data sets
• Design and build optimal data pipelines using AWS and Databricks
• Work with stakeholders on data-related technical issues
• Create data tools for analytics and data science teams
• Improve internal processes for scalability and automation
• Maintain a culture of engagement

Requirements

• Experience building and optimizing data pipelines
• Hands-on experience with Databricks
• Experience with AWS (Lambda, S3, SQS, SNS, CloudWatch)
• Experience with big data tools (Hadoop, Spark, Kafka)
• Experience with SQL and NoSQL databases
• BS/MS in Computer Science or related field
• Strong analytic and communication skills

Benefits

• No benefits