Data Engineer
Location | Pittsburgh, United States of America |
Date Posted | November 1, 2024 |
Category |
Computer / Hardware / Software
|
Job Type |
Full-time
|
State | Pennsylvania (PA) |
Description
At Whitman, Requardt & Associates, LLP, we are "People Focused and Project Driven". We have been in business for more than 105 years and we are known for our quality work and quality employees. This is your chance to join our team - help us to design the infrastructure and buildings that improve the world!
Do you love building the foundation for data-driven decisions? Are you passionate about wrangling messy data and turning it into insights? If so, then we want to hear from you!
We are searching for a talented and experienced Data Engineer to join our growing team. In this role, you will play a critical part in designing, developing, and maintaining the data infrastructure that fuels our organization's analytics capabilities.
Responsibilities:
- Design and implement scalable data pipelines for ingesting, transforming, and loading data from various sources (databases, APIs, etc.)
- Develop and maintain data models to optimize data storage, retrieval, and analysis.
- Ensure data quality and integrity through data cleansing, validation, and transformation techniques.
- Automate data processing workflows using scripting languages and orchestration tools (e.g., Python, R, etc.)
- Document and curate metadata and QA/QC results.
- Work closely with Data Scientists, and other stakeholders to understand data needs and translate them into technical solutions.
- Troubleshoot and resolve complex data issues to ensure smooth data flow.
- Stay up-to-date on the latest big data technologies and trends.
Requirements:
- 4-9 years of progressive experience in data engineering or a related field.
- 4-9 years of experience with spatial data (eg. ESRI. PostGIS, GeoPandas).
- Strong proficiency in SQL and experience with relational databases (e.g.PostgreSQL).
- Excels across a range of data formats including JSON/GeoJSON, parquet and various unstructured formats.
- Experience setting up and using cloud-based data platforms (e.g., Azure with Snowflake or Databricks and Lakehouse, AWS Athena, Google BigQuery).
- Solid understanding of data warehousing concepts (ETL processes, data modeling).
- Experience with data ingestion tools and data workflow orchestration tools.
- Programming experience in Python and/or R.
- Experience with version control systems (e.g., Git).
- Ability to work collaboratively and communicate with a growing team.
Preferred Qualifications:
- Experience with machine learning model deployment.
- Experience with feature engineering and monitoring.
- Experience in the Architecture & Engineering space – transportation, asset management, transit, water resources etc.
- Experience implementing and standardizing data governance best practices.
Benefits:
WRA recognizes that employees play an important role in its success. Our commitment to full-time employees is reflected in the comprehensive benefits package we offer:
- Flexible work schedule options
- Competitive salary
- Leave accrual and paid holidays
- Healthcare benefits
- Group Life Insurance, as well as additional optional life Insurance, short and long term disability insurance
- Flexible spending accounts for medical and dependent care reimbursement
- 401(k) Retirement Plan
- Tuition Reimbursement
- Employee Assistance Program
- Parental and maternity leave benefits
WRA is an equal opportunity/affirmative action employer and complies with all applicable anti-discrimination laws.
Applicants must be currently authorized to work in the United States on a full-time basis without the need for employment-based visa sponsorship now or in the future. WRA will not sponsor applicants for U.S. work visa status for this opportunity. (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)
Position # 2314