Hi Michael
Thank youi for your help.
1.
I have updated CLI:
confluent --version
Version: v3.3.0
Git Ref: a4a75ff7
Build Date: 2023-02-23T22:00:37Z
Go Version: go1.20 X:boringcrypto (windows/amd64)
Development: false
-
It is getting better but still I am having issues(something related to not be able to find plugins ):
A bit frustraiting . Could you please advise ? Just in case : I am using windows machine and I am not familiar with JAVA
Here is a log (I am using: GitHub - mmuehlbeyer/data-mesh-demo: A Data Mesh prototype built on Confluent Cloud):
$ make data-mesh
Let’s go build a Data Mesh!
====== Preflight Checks.
confluent version ok
logged into confluent CLI
jq installed
====== Create a new ccloud-stack to bootstrap the Data Mesh.
This example runs on Confluent Cloud, sign up here:
https://www.confluent.io/confluent-cloud/tryfree/
The example uses real Confluent Cloud resources that may be billable, including connectors
and ksqlDB applications that may have hourly charges. The end of this script shows a command
you can run to destroy all the cloud resources, and you should verify they are destroyed.
New Confluent Cloud signups receive $400 to spend within Confluent Cloud during their first
60 days. Use Confluent Cloud promo code C50INTEG to receive an additional $50 free usage.
This will sufficiently cover one day of running this example, beyond which you may be billed
for the Confluent Cloud resources until you destroy them.
Do you still want to run this script? [y/n] y
Creating Confluent Cloud stack for service account demo-app-7707, ID: sa-21181y.
Waiting up to 720 seconds for Confluent Cloud cluster to be ready and for credentials to propagate
Sleeping an additional 80 seconds to ensure propagation of all metadata
Adding role-binding to sa-21181y on env-1j9q15
{
“principal”: “User:sa-21181y”,
“role”: “EnvironmentAdmin”
}
Waiting for role-binding to propagate
[
{
“principal”: “User:sa-21181y”,
“email”: “”,
“role”: “EnvironmentAdmin”,
“environment”: “env-1j9q15”,
“cloud_cluster”: “”,
“cluster_type”: “”,
“logical_cluster”: “”,
“resource_type”: “”,
“name”: “”,
“pattern_type”: “”
}
]
IMPORTANT: Confirm that the users or service accounts that will interact with this cluster have the required privileges to access Schema Registry.
Set API Key “T3X57GQ6JFB7D2GF” as the active API key for “lkc-zgwzdz”.
Client configuration file saved to: stack-configs/java-service-account-sa-21181y.config
Generating component configurations from stack-configs/java-service-account-sa-21181y.config and saving to the folder delta_configs
Sleep an additional 2 minutes to wait for all Confluent Cloud metadata to propagate
====== Add new tag definition to the Data Catalog.
Define a new tag in the Data Catalog called DataProduct:
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2060 100 1470 100 590 1604 644 --:–:-- --:–:-- --:–:-- 2251[{“category”:“CLASSIFICATION”,“createdBy”:“root”,“updatedBy”:“root”,“createTime”:1677513519844,“updateTime”:1677513519844,“version”:1,“name”:“DataProduct”,“description”:“Data Product Attributes”,“typeVersion”:“1.0”,“attributeDefs”:[{“name”:“owner”,“typeName”:“string”,“isOptional”:false,“cardinality”:“SINGLE”,“valuesMinCount”:1,“valuesMaxCount”:1,“isUnique”:false,“isIndexable”:false,“includeInNotification”:false,“searchWeight”:-1,“options”:{“maxStrLength”:“5000”}},{“name”:“description”,“typeName”:“string”,“isOptional”:true,“cardinality”:“SINGLE”,“valuesMinCount”:0,“valuesMaxCount”:1,“isUnique”:false,“isIndexable”:false,“includeInNotification”:false,“searchWeight”:-1,“options”:{“maxStrLength”:“5000”}},{“name”:“domain”,“typeName”:“string”,“isOptional”:true,“cardinality”:“SINGLE”,“valuesMinCount”:0,“valuesMaxCount”:1,“isUnique”:false,“isIndexable”:false,“includeInNotification”:false,“searchWeight”:-1,“options”:{“maxStrLength”:“5000”}},{“name”:“sla”,“typeName”:“string”,“isOptional”:true,“cardinality”:“SINGLE”,“valuesMinCount”:0,“valuesMaxCount”:1,“isUnique”:false,“isIndexable”:false,“includeInNotification”:false,“searchWeight”:-1,“options”:{“maxStrLength”:“5000”}},{“name”:“quality”,“typeName”:“string”,“isOptional”:true,“cardinality”:“SINGLE”,“valuesMinCount”:0,“valuesMaxCount”:1,“isUnique”:false,“isIndexable”:false,“includeInNotification”:false,“searchWeight”:-1,“options”:{“maxStrLength”:“5000”}}],“superTypes”:,“entityTypes”:[“sr_subject_version”]}]
View the new tag definition:
{
“category”: “CLASSIFICATION”,
“createdBy”: “root”,
“updatedBy”: “root”,
“createTime”: 1677513519844,
“updateTime”: 1677513519844,
“version”: 1,
“name”: “DataProduct”,
“description”: “Data Product Attributes”,
“typeVersion”: “1.0”,
“attributeDefs”: [
{
“name”: “owner”,
“typeName”: “string”,
“isOptional”: false,
“cardinality”: “SINGLE”,
“valuesMinCount”: 1,
“valuesMaxCount”: 1,
“isUnique”: false,
“isIndexable”: false,
“includeInNotification”: false,
“searchWeight”: -1,
“options”: {
“maxStrLength”: “5000”
}
},
{
“name”: “description”,
“typeName”: “string”,
“isOptional”: true,
“cardinality”: “SINGLE”,
“valuesMinCount”: 0,
“valuesMaxCount”: 1,
“isUnique”: false,
“isIndexable”: false,
“includeInNotification”: false,
“searchWeight”: -1,
“options”: {
“maxStrLength”: “5000”
}
},
{
“name”: “domain”,
“typeName”: “string”,
“isOptional”: true,
“cardinality”: “SINGLE”,
“valuesMinCount”: 0,
“valuesMaxCount”: 1,
“isUnique”: false,
“isIndexable”: false,
“includeInNotification”: false,
“searchWeight”: -1,
“options”: {
“maxStrLength”: “5000”
}
},
{
“name”: “sla”,
“typeName”: “string”,
“isOptional”: true,
“cardinality”: “SINGLE”,
“valuesMinCount”: 0,
“valuesMaxCount”: 1,
“isUnique”: false,
“isIndexable”: false,
“includeInNotification”: false,
“searchWeight”: -1,
“options”: {
“maxStrLength”: “5000”
}
},
{
“name”: “quality”,
“typeName”: “string”,
“isOptional”: true,
“cardinality”: “SINGLE”,
“valuesMinCount”: 0,
“valuesMaxCount”: 1,
“isUnique”: false,
“isIndexable”: false,
“includeInNotification”: false,
“searchWeight”: -1,
“options”: {
“maxStrLength”: “5000”
}
}
],
“superTypes”: ,
“entityTypes”: [
“sr_subject_version”
]
}
====== Create a new Data Product called stocktrades.
Created topic “stocktrades”.
confluent kafka topic create stocktrades
Creating connector from /c/data-mesh-demo_m/scripts/connectors/ccloud-datagen-stocktrades.json
2023-02-27T15:58:43.920Z [DEBUG] Searching $PATH for plugins. Plugins can be disabled in C:\Users\andrey.local.confluent\config.json.
Error: unable to parse config /proc/2137/fd/63: unable to read config file /proc/2137/fd/63: open /proc/2137/fd/63: The system cannot find the path specified.
ERROR: Exit status was not 0 while creating connector from /c/data-mesh-demo_m/scripts/connectors/ccloud-datagen-stocktrades.json. Please troubleshoot and try again
make: *** [Makefile:61: data-mesh] Error 1
