# Kafka connect csv and cassandra

**URL:** <https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272>\
**Category:** Kafka Connect\
**Created:** [3 November 2021 16:08 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272 "2021-11-03T16:08:19Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Omar-AlQashlan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/omar-alqashlan/32/1183_2.png) [@Omar-AlQashlan](https://forum.confluent.io/u/Omar-AlQashlan)\
**Post date:** [3 November 2021 16:08 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/1 "2021-11-03T16:08:19Z")

</div>

hi everyone, i am having empty rows in csv , i am using spooldir connector i want this empty data to be replaced by a value when transferred from csv to kafka or when transferred from kafka to cassandra  
note : i am using datastax connector from kafka to cassanda , also i tried to set default but nothing happened  
thanks in advance

---

<div class="post-metadata">

**Author:** ![mitchell-h](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mitchell-h/32/1129_2.png) [@mitchell-h](https://forum.confluent.io/u/mitchell-h)\
**Post date:** [4 November 2021 19:37 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/2 "2021-11-04T19:37:07Z")

</div>

It sounds like you’re reading in blank lines from your source CSV files? If this is correct, [Filter (Apache Kafka) | Confluent Documentation](https://docs.confluent.io/platform/current/connect/transforms/filter-ak.html) is probably the easiest solution. It allows you to filter out things like blank lines. There are other Kafka Connect SMTs that come with Confluent packaging or Apache Kafka, they are linked in the doc above.

---

<div class="post-metadata">

**Author:** ![Omar-AlQashlan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/omar-alqashlan/32/1183_2.png) [@Omar-AlQashlan](https://forum.confluent.io/u/Omar-AlQashlan)\
**Post date:** [5 November 2021 18:56 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/3 "2021-11-05T18:56:59Z")

</div>

hi mitchel yes iam reading blank lines from csv so i want to replace them by other value , i donot want to drop those nulls ?

---

<div class="post-metadata">

**Author:** ![mitchell-h](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mitchell-h/32/1129_2.png) [@mitchell-h](https://forum.confluent.io/u/mitchell-h)\
**Post date:** [5 November 2021 19:12 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/4 "2021-11-05T19:12:12Z")

</div>

Then something like [TombstoneHandler | Confluent Documentation](https://docs.confluent.io/platform/current/connect/transforms/tombstonehandler.html) or writing your own would be appropriate.

---

<div class="post-metadata">

**Author:** ![Omar-AlQashlan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/omar-alqashlan/32/1183_2.png) [@Omar-AlQashlan](https://forum.confluent.io/u/Omar-AlQashlan)\
**Post date:** [5 November 2021 21:42 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/5 "2021-11-05T21:42:04Z")

</div>

I tried to write my own but you know Custom transformations are not available for managed connectors

---

<div class="post-metadata">

**Author:** ![mitchell-h](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mitchell-h/32/1129_2.png) [@mitchell-h](https://forum.confluent.io/u/mitchell-h)\
**Post date:** [8 November 2021 21:57 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/6 "2021-11-08T21:57:07Z")

</div>

With hosted Confluent Connect you really don’t have any other options except to either fix the files before the ingested into Kafka. Or ingest them into topic-a, stream process them to fix whatever(ksql is a great option here), then produce them to topic-b for consumption.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/confluentcommunity/original/1X/c49438c90c9df282e9996fdf6971be890c71b65a.svg) [@system](https://forum.confluent.io/u/system)\
**Post date:** [15 November 2021 21:57 UTC](https://forum.confluent.io/t/kafka-connect-csv-and-cassandra/3272/7 "2021-11-15T21:57:23Z")

</div>

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.
