Kafka Migration engineer ( .NET Kafka)

Kryptos Technologies Ltd, City of Westminster

Kafka Migration engineer ( .NET Kafka)

Salary not available. View on company website.

Kryptos Technologies Ltd, City of Westminster

  • Full time
  • Temporary
  • Onsite working

Posted 2 weeks ago, 9 Jul | Get your application in now before you miss out!

Closing date: Closing date not specified

Job ref: d5bdbde5e96648a48407de782109456e

Location ref: City of Westminster

Full Job Description

Migrate all Kafka producers and consumers from Kafka to Confluent Cloud

Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)

Validate message flows end-to-end for apps acting as both producer and consumer

Ensure consumer group configurations, offset management, and error handling are correct post-migration

Kafka throughput validation and performance testing

Work with .NET engineers to resolve application-level Kafka integration issues

Note: This role requires strong .NET skills in addition to Kafka expertise. All producers and consumers are .NET applications - APIs produce messages, and some services both consume and produce. This is not an infrastructure-only Kafka role; it requires reading, modifying, and validating .NET Kafka client code., C# / .NET - strong coding ability (reading and modifying producer/consumer code)

Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)

Confluent Cloud - SASL/PLAIN authentication, Schema Registry, ACLs

Kafka internals: topics, partitions, consumer groups, offset management, rebalancing

Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers

Troubleshooting Kafka connectivity and message flow issues in .NET applications

Kafka monitoring (consumer lag, throughput, error rates)

Nice to Have

Experience with apps that are both consumers and producers (event-driven architectures)

Schema evolution and compatibility strategies in Schema Registry

Performance tuning (batch size, compression) for .NET producers

Kafka Connect and MirrorMaker for migration scenari

Direct job link

https://www.jobs24.co.uk/job/kafka-migration-engineer-net-kafka-127088250