Client Name: City of New York
Start Date: July 2024
End Date: July 2025
Contract Length (in weeks): 52
SCOPE OF SERVICES
Client’s Office of Data Analytics (ODA) works with City agencies and their data to help serve New Yorkers
more equitably and effectively. This work takes three main forms: analyzing data to improve City agency operations; making Open Data more accessible to all New Yorkers; and advancing citywide
data infrastructure, integration, and sharing.
ODA seeks a Full Stack Developer - Data Engineer responsible for designing, developing, and
maintaining data-driven applications and systems. Work closely with the team to build scalable and
efficient solutions that leverage both front-end and back-end technologies.
TASKS:
- Design, develop, and maintain full-stack applications using Java, JavaScript, HTML/CSS, and
other relevant technologies.
- Manage the development of APIs, for data access or landing data as output for further
downstream consumption in the appropriate target data store.
- Implement data models, ETL processes, and data pipelines to support data-driven
applications using SQL, cloud, and ‘big data’ technologies.
- Develop data pipelines that conform multiple sources of transactional data to a unified
standard and integrate this data into the MDM repository.
- Conduct thorough quality assurance testing of code and technical deliverables prior to
submission and conduct peer review of code created by other developers on the project.
- Optimize performance and scalability of data-driven applications and systems.
- Collaborate with cross-functional teams to understand data requirements and translate them
into technical solutions.
- Ensure data security, integrity, and compliance with privacy regulations.
- Create, update, and maintain system documentation.
- Coordinate appropriate security scan accreditations.
- Perform special projects and initiatives as assigned.
Requirements
MANDATORY SKILLS/EXPERIENCE
Note: Candidates who do not have the mandatory skills will
not be considered
- 8+ years of experience in the Java application development and implementation of large
technology projects.
- 5+ years of experience in writing SQL.
- Experience in front-end and back-end application development.
- Proven experience as a Full Stack Developer with expertise in Java, Spring Boot, Python,
JavaScript, and related frameworks (e.g., React, Angular, Node.js, Vue)
- Experience with RDBMS (Oracle, MySQL, PostgreSQL)
- Understand basic design principles behind a scalable application.
- Experience with service-oriented architecture and RESTful web services
- Knowledge of JSON, XML, XSD, WSDL, JDBC, MQ, SOAP concepts
- Strong problem-solving skills and enjoy learning new technologies.
- Experience with an agile, iterative development process and version control tools such as Git,
GitHub, Subversion.
- Strong understanding of data engineering concepts and experience with tools such as SQL,
NoSQL databases, and data processing frameworks (e.g., Apache Spark).
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies
(e.g., Docker, Kubernetes) is a plus.
- Experience working on large datasets, data models and full-cycle data pipeline development.
- Experience working with Amazon Web Services or Microsoft Azure cloud computing platform
and services.
- Experience developing cloud-ready applications.
- Excellent problem-solving and communication skills.
- Ability to work effectively in a fast-paced and collaborative environment.
DESIRABLE SKILLS/EXPERIENCE:
- ETL experience in development with the suite of tools from Informatica PowerCenter, IBM
DataStage and B2B Data Transformation.
- Experience using Oracle 12g, AWS RDS/MySQL and/or a database appliance.
- Knowledge of IBM Master Data Management (MDM) implementation
- Knowledge of metadata-driven enterprise reporting platforms.
- Prior experience working on complex data integration projects.