Back to all jobs
C

Lead Data Integration Dev-Ops / Systems Engineer

Cityofphiladelphia

Philadelphia · PA · us Full-time 1d ago

Job description

Dev-Ops and data integration systems engineering at the City offers a unique opportunity for impactful, dynamic work and professional growth while supporting platforms that directly improve City operations and public services. The Lead Dev-Ops / Data Integration Systems Engineer will help design, automate, secure, monitor, and improve the infrastructure that powers the City’s enterprise data integration and data engineering platforms. This position will help establish reusable infrastructure patterns, improve observability and security, reduce operational bottlenecks, and strengthen the City’s ability to operate reliable data integration systems. The role will support cloud and hybrid infrastructure, deployment automation, containerized services, monitoring, secure access patterns, and operational practices for platforms such as DataBridge, DataBridge-Airflow, AIS, MuleSoft, enterprise APIs, data warehouses, and related systems. The Lead Dev-Ops / Data Integration Systems Engineer will support priority infrastructure, platform, and integration needs across City government, while also contributing to the broader enterprise portfolio of data integrations, platforms, and systems maintained by CityGeo. We are looking for a candidate who is not only technically skilled, but also passionate about leveraging reliable infrastructure, automation, and data systems to improve City operations and community life. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work, and data-driven decision-making, we encourage you to apply. Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations (https://metadata.phila.gov/) and open data publishing. Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include: https://Atlas.phila.gov https://property.phila.gov https://Openmaps.phila.gov https://streetsmartphl.phila.gov/ www.phila.gov/solarmap www.phila.gov/stressmap Essential Functions · Design, implement, maintain, and improve cloud and hybrid infrastructure supporting enterprise data integration platforms and data engineering workflows. · Build and maintain deployment automation for Linux and Windows servers, containerized workloads, databases, integration runtimes, APIs, and workflow orchestration systems. · Develop and maintain Infrastructure-as-Code and automation using tools such as Terraform, AWS CDK, Helm, GitHub Actions, Jenkins, Python, Bash, and PowerShell. · Support containerized services and orchestration patterns using Docker and AWS services such as ECS, EKS, ECR, Batch, CloudWatch, and related tools. · Configure, improve, and maintain system monitoring, alerting, logging, and observability using tools such as CloudWatch, Grafana, Prometheus, AlertManager, and SNS. · Support secure infrastructure patterns for sensitive or restricted data, including access control, secret management, encryption, network segmentation, auditability, and least-privilege design. · Support enterprise integration platforms and data systems, including DataBridge, DataBridge-Airflow, AIS, MuleSoft, Postgres/PostGIS environments, APIs, and related application stacks. · Improve operational reliability through backup automation, deployment standardization, incident response practices, performance tuning, and lifecycle management. · Work closely with data engineers, data architects, application teams, vendors, security teams, and department partners to support reliable integrations and data services. · Translate platform requirements into scalable infrastructure designs that can be reused across multiple projects and departments. · Troubleshoot complex production issues involving infrastructure, networking, containers, databases, pipelines, authentication, scheduling, or application runtime environments. · Contribute to DevOps standards, infrastructure documentation, operational runbooks, architecture diagrams, and reusable deployment patterns. · Support continuous improvement of the City’s enterprise data integration ecosystem. Competencies, Knowledge, Skills and Abilities Competencies: · Clear and concise writing and communication skills, with a documentation-driven approach. · Creative problem-solving and critical thinking. · Strong operational judgment and attention to reliability, security, and maintainability. · Ability to manage multiple systems, projects, and production support needs simultaneously. · Ability to coordinate technical implementation work with engineers, analysts, vendors, and stakeholders. · Ability to work with non-technical stakeholders and translate operational needs into technical solutions. · Commitment to automation, repeatability, and continuous improvement. Knowledge and Skills: · Strong Linux systems administration skills; Windows systems administration experience is also useful. · Strong command-line skills, including Bash and PowerShell. · Strong scripting skills with Python, Bash, or similar tools. · Experience with Docker and containerized application deployment. · Experience with AWS cloud services, preferably including ECS, EKS, ECR, Batch, CloudWatch, IAM, VPC/networking, S3, RDS, and related services. · Experience with Infrastructure-as-Code tools such as Terraform, AWS CDK, or Helm. · Experience with CI/CD tools such as GitHub Actions and Jenkins. · Experience with monitoring, logging, alerting, and observability tools such as Grafana, Prometheus, AlertManager, CloudWatch, and SNS. · Experience supporting Postgres or other relational database environments. · Familiarity with Apache Airflow, DBT, MuleSoft, Kubernetes, and enterprise integration platforms. · Understanding of secure systems design, access control, secret management, and production change management. · Experience hosting or supporting GIS, data visualization, data management, or integration tools is a plus. · Experience in a public-sector or large enterprise environment is a plus. Abilities: · To troubleshoot system health, deployment issues, networking problems, container failures, database performance, and production incidents. · To design maintainable, secure, and repeatable infrastructure patterns. · To automate routine operational tasks and reduce manual maintenance burden. · To maintain clean, secure, and reliable data environments. · To work effectively in a hybrid cloud and on-premises environment. · To support systems that handle sensitive, operationally important, or resident-facing data. · To communicate complex technical concepts in understandable terms. · To contribute to shared engineering standards and improve operational practices over time. · To identify opportunities for infrastructure modernization and improvement Bachelor’s/advanced degree in Computer Science, Information Systems, a related field or equivalent work experience. · Five (5) years of progressively responsible experience in DevOps, systems engineering, cloud infrastructure, platform engineering, site reliability engineering, or a related role. · Demonstrated experience managing systems or software stacks in a production environment with appropriate testing, deployment, monitoring, and operational support practices. · Experience administering Linux-based environments, cloud infrastructure, containerized applications, and enterprise integration or data platforms. · Experience with automation, Infrastructure-as-Code, CI/CD, monitoring, and production support. · Dedication to making Philadelphia municipal government more robust, efficient, equitable, and resilient. · Previous work in a public-sector or large-organization setting is a plus. Salary Not to Exceed: $100,000 Starting salary to be determined based on experience and qualifications. Important: To apply, candidates must provide a cover letter and a resume. Did you know? We offer Comprehensive health coverage for employees and their eligible dependents Our wellness program offers eligibility into the discounted medical plan Employees receive paid vacation, sick leave, and holidays Generous retirement savings options are available Pay off your student loans faster - As a qualifying employer, City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness. Enjoy a Free Commute on SEPTA - Starting September 1, 2023, eligible City employees will no longer have to worry about paying for SEPTA public transportation. Whether you're a full-time, part-time, or provisional employee, you can seize the opportunity to sign up for the SEPTA Key Advantage Program and receive free Key cards for free rides on SEPTA buses, trains, trolleys, and regional rails. Unlock Tuition Discounts and Scholarships - The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area, ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses, extending not only to City employees but in some cases, spouse and dependents too! *The successful candidate must be a city of Philadelphia resident within six months of hire Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated. The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr@phila.gov. For more information, go to: Human Relations Website: http://www.phila.gov/humanrelations/Pages/default.asp A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to love living and working here. With a workforce of over 30,000 people, and more than 1,000 different job categories, the City of Philadelphia offers boundless opportunities to make an impact. As an employer, the City of Philadelphia values inclusion, integrity, innovation, empowerment, and hard work above all else. We offer a vibrant work environment, comprehensive health care and benefits, and the experience you need to grow and excel. If you’re interested in working with a passionate team of people who care about the future of Philadelphia, start here. What We Offer: Impact - The work you do here matters to millions. Growth - Philadelphia is growing, why not grow with it? Diversity & Inclusion - Find a career in a place where everyone belongs. Benefits - We care about your well-being.