We need a
DevOps engineer to assist developers in utilizing AI for processing unstructured data. This involves establishing a solution for the acquisition, movement, and ingestion of large volumes of unstructured data on a daily basis, and making this data available for AI processing.
Skills, in priority order (from must-have to nice-to-have), include:- DevOps that can code: 25% coding, 75% operations
- Python
- Kubernetes (K8s), Airflow/Dagster/Airbyte, Argo Workflows, Databricks
- Infrastructure as Code (IaC) - Terraform, Cloud Development Kit (CDK)
- Monitoring (Datadog, Splunk, PagerDuty) - managing a production system
- Event-based systems - Kafka
- APIs, Layer 3/7 networking (Envoy)
- Application authentication (Okta)
- AI stack - OpenAI, Claude 3, Pinecone, SageMaker, Bedrock
- English B2