IQ Inc
Lead Data Engineer
IQ Inc. is searching for a Lead Data Engineer who enjoys designing tailor-made architectures. In this position you will be implementing data orchestration pipelines, data sourcing, cleansing, and augmentation and quality control processes. Mentoring and developing others, along with working with diverse client backgrounds and industries will also be a significant part of your daily activities.

In this role you will be:
  • Designing flexible data models that are extensible to support existing and new use cases
  • Deploying machine learning models in production
  • Working with client architects and engineering teams to ensure long term client enablement
  • Leading the engineering team to execute and deliver quality scalable software 
  • Assisting with business development through writing proposals, scoping projects
  • Contributing to leadership through written publications and speaking at events and conference
Your Experiences & Qualifications Include:
  • 6+ years of experience working on large scale, full lifecycle data implementation projects 
  • BS/BA in data engineering, software engineering, data science, computer science, applied mathematics, or equivalent experience
  • A solid foundation in data structures, algorithms, and system with fundamentally strong programming skills and software development best practices 
  • Proven success working in and promoting a rapidly changing, collaborative, and iterative product development environment
  • 5+ years of experience in a client facing role
  • 4+ years hands on experience developing ETL/ELT workflows with Python, Scala or Java
  • 2+ years professional development experience with some of the AWS/Azure/GCP data stack to deploy data pipelines e.g., S3, Blob storage, AWS Glue, Azure Data Factory, Cloud Dataflow, EMR, Dataproc, etc
  • A deep understanding of relational and MPP database technology, working with at least one of the major databases platforms (Oracle, SQLServer, Teradata, MySQL, Postgres) and cloud based MPP databases (Redshift, Synapse, Big Query, Snowflake)
  • A deep knowledge of performant SQL and understanding of relational database technology
  • Experience working with Big Data technologies such as Spark, Hive, Impala, Druid, or Presto
Additional consideration to candidates who possess some of the following criteria:
  • Knowledge of distributed data processing
  • Experience leading and delivering projects on budget and on time
  • Experience managing and supporting diverse data engineering teams 
  • DevOps and DataOps skills including “infrastructure as code” systems like CloudFormation or Terraform
  • Data system performance tuning 
  • Implementation of predictive analytics and machine learning models (MLlib, scikit-learn, etc)
  • An understanding of “big picture” business requirements that drive architecture and design decisions
  • Strong interpersonal and communication skills
  • Intellectual curiosity and diverse skillset
  • Willingness to travel around the globe to work with clients and internal teams. At times, this role involves significant travel to client sites. The amount of travel will depend on client needs and nature of projects
**Locations for this position will be based in Pittsburgh, New York City, and Dallas.

What to include in your application:
  • A link to your portfolio that demonstrates your affinity for data engineering and shows how you approach digital challenges
IQ Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, IQ Inc. complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.  IQ Inc. expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of IQ Inc.'s employees to perform their job duties may result in discipline up to and including discharge.
Connect with us!