Big Data Engineer

Position Summary:

The Data Engineer will develop a new data engineering platform that leverage a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed. You will also be assisting with integrating the SQL data warehouse platform as our primary processing platform to create the curated enterprise data model for the company to leverage. You will be part of a team building the next generation data platform and to drive the adoption of new technologies and new practices in existing implementations. You will be responsible for designing and implementing the complex ETL pipelines in cloud data platform and other solutions to support the rapidly growing and dynamic business demand for data and use it to deliver the data as service which will have an immediate influence on day-to-day decision making.

General Duties/Responsibilities (May include but are not limited to):

• Interfacing with business customers, gathering requirements and developing new datasets in data platform
• Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically
• Identifying the data quality issues to address them immediately to provide great user experience
• Extracting and combining data from various heterogeneous data sources
• Designing, implementing, and supporting a platform that can provide ad-hoc access to large datasets
• Modelling data and metadata to support machine learning and AI

Supervisory responsibilities:

N/A

Minimum Requirements:

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.  The requirements listed below are representative of the knowledge, skill, and/or ability required.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

1.       Minimum Experience:

a.       3+ years relevant experience in cloud based data engineering.

b.       Requires Spark and Scala experience

c.       Demonstrated ability in data modeling, ETL development, EDI Development and data warehousing.

d.       Data Warehousing Experience with SQL Server, Oracle, Redshift, Teradata, etc.

e.       Experience with Big Data Technologies (NoSQL databases, Hadoop, Hive, Hbase, Pig, Spark, Elasticsearch etc.)

f.        Experience in using Python, .net, Java and/or other data engineering languages

g.       Knowledge and experience of SQL Server and SSIS.

h.       Experience with X12(837,834,278) and HL7 transactions

2.       Education/Licensure:

a.       Bachelors or Masters in Computer Science, Engineering, Mathematics, Statistics, or related field

3.       Other:

a.       Excellent communication, analytical and collaborative problem-solving skills

b.       Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically

c.       Preferred

 i.      A Healthcare domain and data experience

ii.      Healthcare EDI experience is a plus

iii.      API development experience is a plus

iv.      Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.

v.      Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets

vi.      Experience building data products incrementally and integrating and managing datasets from multiple sources

vii.      Experience leading large-scale data warehousing and analytics projects, including using Azure or AWS technologies – SQL Server, Redshift, S3, EC2, Data-pipeline, Data Lake, Data Factory and other big data technologies

viii.      Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space

ix.      Linux/UNIX including to process large data sets.

x.      Experience with Azure, AWS or GCP is a plus

xi.      Microsoft Azure Certification is a plus

xii.      Demonstrable track record dealing well with ambiguity, prioritizing needs, and delivering results in an agile, dynamic startup environment

xiii.      Problem solving skills and Ability to meet deadlines are a must

xiv.      Microsoft Azure Certification is a plus

xv.      Python and Java are a plus

xvi.      Experience with X12(837,834,278) and HL7 transactions preferred

1. Work Environment

1. The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Essential Physical Functions:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

1. While performing the duties of this job, the employee is regularly required to talk or hear. The employee regularly is required to stand, walk, sit, use hand to finger, handle or feel objects, tools, or controls; and reach with hands and arms.
2. The employee frequently lifts and/or moves up to 10 pounds. Specific vision abilities required by this job include close vision and the ability to adjust focus.

Alignment Healthcare, LLC is proud to practice Equal Employment Opportunity and Affirmative Action. We are looking for diversity in qualified candidates for employment: Minority/Female/Disable/Protected Veteran.