Responsibilities:
- Function as a thought-leader for the data platform teams; identify upcoming issues and present solutions in advance to support ongoing development
- Analyze complex technical scenarios and provide recommendations based on research and proof-of-concepts
- Create documentation and visual artifacts outlining designs that enable engineers to replicate solutions
- Lead data storage selection, analyze and provide recommendations to match data storage mediums to access patterns and non-functional requirements
- Support the design and scaling of the system
- Support the design and development of the company’s data science production environment
- Lead microservice design for core data utilities, including master data management, data cataloging, lineage, and other core functions
- Advise on monitoring, optimization, and operationalization of services within the data platform
- Support technology cost analysis and capacity planning
- Monitor the ever-changing technology landscape, provide recommendation to best support Hagerty’s data-centric vision
Required Experience:
- Bachelor’s degree in Computer Science/Engineering or relevant areas
- 5+ years of progressively responsible technology experience
- Proven ability to communicate clearly to a variety of stakeholders over different mediums
- Able to work independently, navigate ambiguity on requirements and scope, and manage multiple disparate projects with competing deadlines
- Working knowledge of IT processes such as ITIL, Agile, DevOps, Change Management, Service Level Agreements
- Strong domain experience in data required; such as developing or maintaining data pipelines, ETL scripts, performing database administration, or supporting other automated data management functions
- Experience with performance testing and tuning or production support, preferably over data pipelines
- Experience or a working knowledge of integration pattern design including API endpoint design, file transfer, and message queuing and caching
- Experience or a working knowledge of microservice design principles
- Knowledge of data consistency, immutability, and idempotent design patterns
- Experience or a working knowledge of data modeling in relational and NoSQL data stores
- Familiarity with data science development processes and platforms
- Experience designing and implementing solutions that support large data volumes and streaming data preferred
- Competent coding proof-of-concept solutions in Python preferred
- Good command of written and spoken English is a plus
