# Tabular Iceberg Sink Connector - Cannot read from Trino

**URL:** <https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342>\
**Category:** Kafka Connect\
**Created:** [10 October 2024 07:10 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342 "2024-10-10T07:10:19Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![sv9](https://avatars.discourse-cdn.com/v4/letter/s/848f3c/32.png) [@sv9](https://forum.confluent.io/u/sv9)\
**Post date:** [10 October 2024 07:10 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342/1 "2024-10-10T07:10:19Z")

</div>

Hi,

We are currently exploring Kafka Connect to read data from Kafka (specifically, the Azure Event Hub Kafka endpoint) and write it to Iceberg tables. I’m using Polaris for the REST catalog and Azure as the object store.

I created a catalog in Polaris using the following payload:

```auto
{
  "catalog": {
    "type": "INTERNAL",
    "name": "catalogName",
    "properties": {
      "default-base-location": "abfss://container@storage-account.dfs.core.windows.net"
    },
    "storageConfigInfo": {
      "storageType": "AZURE",
      "tenantId": "xxxxxxxxxxxxx",
      "allowedLocations": ["abfss://container@storage-account.dfs.core.windows.net/warehouse"]
    }
  }
}

```

Next, I created a namespace in Polaris and set up a sink connector in Kafka Connect with the following configuration:

```auto
{
  "connector.class": "io.tabular.iceberg.connect.IcebergSinkConnector",
  "tasks.max": "2",
  "topics": "metric",
  "iceberg.tables": "feed.replay-messages",
  "iceberg.tables.auto-create-enabled": "true",
  "iceberg.tables.schema-force-optional": "true",
  "iceberg.catalog.type": "rest",
  "iceberg.catalog.uri": "http://apache-polaris:8181/api/catalog",
  "iceberg.catalog.io-impl": "org.apache.iceberg.azure.adlsv2.ADLSFileIO",
  "iceberg.catalog.include-credentials": "true",
  "iceberg.catalog.warehouse": "catalogName",
  "iceberg.catalog.token": "xxxxxx",
  "name": "sink-feed",
  "key.converter": "org.apache.kafka.connect.json.JsonConverter",
  "value.converter": "org.apache.kafka.connect.json.JsonConverter",
  "key.converter.schemas.enable": "false",
  "value.converter.schemas.enable": "false"
}

```

I also set the environment variables `AZURE_CLIENT_ID`, `AZURE_TENANT_ID`, and `AZURE_CLIENT_SECRET` in both the Kafka Connect and Polaris pods.

The table gets created successfully, and I can see both the metadata and data folders. The metadata folder contains a JSON file, and the data folder has a few Parquet files.

However, when I attempt to read the table from Trino (after setting up the catalog with the correct configuration), I only see the column names, but no rows are returned. I’ve checked the Parquet files in Azure Blob Storage, and they do contain data.

Could someone help me resolve this issue?

---

<div class="post-metadata">

**Author:** ![Cerchie](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/cerchie/32/3978_2.png) [@Cerchie](https://forum.confluent.io/u/Cerchie)\
**Post date:** [10 October 2024 20:19 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342/2 "2024-10-10T20:19:45Z")

</div>

Help me understand: where are you reading from with Trino?

If using a Kafka connector, perhaps this from the [Trino docs](https://trino.io/docs/current/connector/kafka.html) would help:

“Topics can be live. Rows appear as data arrives, and disappear as segments get dropped. This can result in strange behavior if accessing the same table multiple times in a single query (e.g., performing a self join).”

---

<div class="post-metadata">

**Author:** ![sv9](https://avatars.discourse-cdn.com/v4/letter/s/848f3c/32.png) [@sv9](https://forum.confluent.io/u/sv9)\
**Post date:** [10 October 2024 21:07 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342/3 "2024-10-10T21:07:23Z")

</div>

Hi Thanks for replying. I am reading from eventhubs (Kafka) and ingesting into Iceberg in Azure Storage. This is for storing all my data for warehousing purposes. I am then trying to read that Iceberg data using Trino. I am not directly querying Kafka.

---

<div class="post-metadata">

**Author:** ![Cerchie](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/cerchie/32/3978_2.png) [@Cerchie](https://forum.confluent.io/u/Cerchie)\
**Post date:** [18 October 2024 19:55 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342/4 "2024-10-18T19:55:34Z")

</div>

Aha. Then I’d think filing an issue with [Trino](https://github.com/trinodb/trino) or reaching out to their community would be the best next step.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/confluentcommunity/original/1X/c49438c90c9df282e9996fdf6971be890c71b65a.svg) [@system](https://forum.confluent.io/u/system)\
**Post date:** [17 November 2024 19:55 UTC](https://forum.confluent.io/t/tabular-iceberg-sink-connector-cannot-read-from-trino/12342/5 "2024-11-17T19:55:49Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.