Software Engineer II - ICONMA, LLC
Urbandale, IA 50322
About the Job
Software Engineer II
Location: Remote
Duration: 12-13 months
Description:
Education:
Degree in an Engineering/Technology discipline or equivalent experience. - University Degree (4 years or equivalent)
Specific Position Requirements:
Primary Roles:
Create and update API interfaces to MySQL backend databases. The API is hosted on AWS ECS and written using Python.
Ingest data into the Enterprise Data Lake from various database/file sources
Transform data and create common tables using Pyspark and SQL
Load data into MySQL from the Enterprise Data Lake
Analyze data using SQL and Pyspark
Create and maintain updates to AWS resources
Supporting Roles:
Work closely with the front end developer on the API specification
Build test scripts in Python to test data replication processes
Work closely with the product manager and end users to understand requirements
Required Skills:
Experience requirements - at least 3 - 5 years of experience with SQL, Python and cloud computing (AWS preferred)
Languages and Frameworks: Python, SQL, Pyspark
Core understanding of AWS services including IAM, Lambda, S3, RDS, ECS and EC2
Experience developing Databricks jobs and pipelines
Other: Docker, containerization concepts, REST API concepts (calling REST APIs using Python)
Additional Skills:
Terraform, Github Actions, Datadog, AWS Database Migration Service, Apache Airflow, REST API development in Python.
As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
Location: Remote
Duration: 12-13 months
Description:
Education:
Degree in an Engineering/Technology discipline or equivalent experience. - University Degree (4 years or equivalent)
Specific Position Requirements:
Primary Roles:
Create and update API interfaces to MySQL backend databases. The API is hosted on AWS ECS and written using Python.
Ingest data into the Enterprise Data Lake from various database/file sources
Transform data and create common tables using Pyspark and SQL
Load data into MySQL from the Enterprise Data Lake
Analyze data using SQL and Pyspark
Create and maintain updates to AWS resources
Supporting Roles:
Work closely with the front end developer on the API specification
Build test scripts in Python to test data replication processes
Work closely with the product manager and end users to understand requirements
Required Skills:
Experience requirements - at least 3 - 5 years of experience with SQL, Python and cloud computing (AWS preferred)
Languages and Frameworks: Python, SQL, Pyspark
Core understanding of AWS services including IAM, Lambda, S3, RDS, ECS and EC2
Experience developing Databricks jobs and pipelines
Other: Docker, containerization concepts, REST API concepts (calling REST APIs using Python)
Additional Skills:
Terraform, Github Actions, Datadog, AWS Database Migration Service, Apache Airflow, REST API development in Python.
As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
Source : ICONMA, LLC