Senior Data Engineer

Starkville, MS
Full Time
Mid Level
Camgian is hiring a senior data engineer to help build and maintain highly optimized and available data pipelines that facilitate its data science and AI/ML developments. Strategically, the candidate will work towards an overall data framework that handles the company's growing data needs. In keeping with this overarching aim, the senior data engineer will understand client needs and use this understanding to gather data from available sources, define data collection needs, integrate, and clean data into desired formats, and outline methods to sustain the data. This information is organized into project requirements and strategy, breaks down work, assigns tasks to junior staff, and monitors’ progress.

A successful candidate will serve many roles, including data architect, designer, and problem solver who enjoys developing methods to capture/collect data, streamlining data into AI/ML development activities, supporting reporting/scientific tools, multi-tasking, and credibly interfacing between technical teams and business stakeholders. Your experience, combined with problem-solving abilities, business understanding, and technical savvy, will be used to identify opportunities to solve existing business problems and look around corners for future opportunities.


Duties/Responsibilities
  • Provide senior-level contribution to a team responsible for the architecture, design, deployment, and maintenance of the company's business data platforms
  • Implement strategies directed at acquiring data and promoting the development of new insights across the business
  • Own and extend the business's data pipeline by collecting, storing, processing, and sustaining large data sets
  • Monitor the existing metrics, analyze data, and lead partnerships with other teams to identify and implement data management process improvements
  • Builds a metadata system where all available data is maintained and cataloged
  • Design, architect, implement and support critical datasets that avail structured and timely access to actionable business insights
  • Oversee activities of junior data engineers, ensuring proper execution of their duties and alignment with business vision and objectives
  • Collaborate with other teams, gathering technical requirements for exceptional data management across the various business lines and the business at large
  • Develop and manage scalable data processing platforms that support exploratory data analysis and real-time analytics
  • Oversee, design, and develop algorithms for real-time data processing within the business and create frameworks that enable quick and efficient data acquisition
  • Contribute to the continual improvement of the business's data platforms through observations and well-researched knowledge
  • Keep track of industry best practices and trends and take advantage of process and system improvement opportunities through acquired knowledge
  • Draft reports and prepare presentations for senior data science and AI/ML leadership. These reports and presentations must be clear, concise, unambiguous, engaging, and convincing, which will demand exceptional communication skills



Basic Qualifications
  • Hold a bachelor’s degree in Computer Science, Applied Mathematics, Engineering, or technology-related field
  • Possess five (5) years of working experience in the data engineering field, preferably as a Data Engineer in a fast-paced environment and complex business setting
  • Deep passion for data and how it can be used to drive new insights. Must possess an ability to design and operationalize high-performance data pipelines that conduct complex data wrangling of large data volumes
  • Must be an expert in SQL, NoSQL, Python, R and have a keen understanding of data modeling, data mining, and data warehousing concepts
  • United States Citizenship


Preferred Qualifications
  • Master's degree or Ph.D. in Computer Science, Statistics, Mathematics, or Information Systems
  • Demonstrated experience in building and maintaining reliable and scalable data platforms as well as working knowledge of varied forms of data infrastructure inclusive of relational databases such as Postgres, non-relational databases such as MongoDB, and time-series databases such as InfluxDB
  • Experience with machine learning, data warehousing, data lakes, and big data infrastructure inclusive of Hadoop, AWS, and container technology such as Docker
  • Excellent verbal and written communication skills with the ability to effectively advocate technical solutions to engineering teams and business audiences
  • Proven ability to convey rigorous technical concepts and considerations to non-experts
  • Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment

Exceptional work ethic, willingness to learn, tenacity not to quit, aptitude to surpass, and strong desire to work in a fast-paced environment with existing and new product lines are necessary for success. Collaboration and cross-pollination with other teams will be frequent; thus, communication, openness, and willingness to share both success and failure are necessary. We are a team-centric organization; there are no individuals. We win and lose together.

Camgian offers a competitive salary, fun work environment, excellent benefits, and an equity opportunity.


Camgian Culture and Core Value Traits
  • Ability to work as part of a team while maintaining independent thinking
  • Self-driven and self-starter, in addition to excellent communication skills
  • Great at thinking outside the box and have an aptitude for innovation and problem solving
Share

Apply for this position

Required*
Apply with Indeed
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

To comply with government Equal Employment Opportunity and/or Affirmative Action reporting regulations, we are requesting (but NOT requiring) that you enter this personal data. This information will not be used in connection with any employment decisions, and will be used solely as permitted by state and federal law. Your voluntary cooperation would be appreciated. Learn more.

Invitation for Job Applicants to Self-Identify as a U.S. Veteran
  • A “disabled veteran” is one of the following:
    • a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or
    • a person who was discharged or released from active duty because of a service-connected disability.
  • A “recently separated veteran” means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.
  • An “active duty wartime or campaign badge veteran” means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.
  • An “Armed forces service medal veteran” means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.
Veteran status


Human Check*