MANTA Installation in IBM Cloud Pak for Data 4.6.x

Photo by bady abbas on Unsplash

MANTA installation in IBM Cloud Pak for Data (CPD)4.5.x was difficult. That is no more an issue in IBM Cloud Pak for Data 4.6.x onwards. This guide will help you install it on IBM CPD 4.6.x and also helps you resolve any MANTA upgrade issues when you upgrade from IBM CPD 4.5.x to 4.6.x.

MANTA Installation in CPD 4.6.X

• Enable MANTA, Data Quality, and Knowledge graph in WKC by running the following command.

cpd-cli manage update-cr \
--component=wkc \
--cpd_instance_ns=${PROJECT_CPD_INSTANCE} \
--patch="{\"install_wkc_core_only\":True,\"enableKnowledgeGraph\":True,\"enableMANTA\":True}"

• Copy the MANTA license file to the OpenShift cluster. Make sure you have access to the license.key file for the MANTA license resides in the directory where you are running the following command.

oc set data secret/manta-keys -n cpd-instance — from-file=license.key=./license.key

• Rebound pods starting with the name MANTA, metadata-discovery and wkc-metadata-import-ui

 oc get po | grep 'metadata-discovery\|manta\|wkc-metadata-imports-ui'

• For the Postgres source, do the following.

oc edit cm metadata-discovery-service-config -n <namespace> 

change the value manta_use_connection_reference field to false save it.

oc delete -n <namespace> “$(oc get pods -o name -n <namespace> | grep metadata-discovery)”

• Create a new Postgres connection in wkc(Not to use the old connection that's already been tried) and try lineage import.
• For Teradata source configuration, update the JDBC driver at the following location. please download the most recent compatible version of the JDBC drivers from the Teradata website (https://downloads.teradata.com/download/connectivity/jdbc-driver), remove the old drivers from the manta-admin-gui pod’s lib directory, and place the new drivers there in the form of two JAR files.
• On manta-admin-gui pod — /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

MANTA manual upgrade from CPD 4.5.x to 4.6.x

Due to any reason, if you had to disable MANTA in CPD 4.5.x during the upgrade and now you enable it again in CPD 4.6.x, then Metadata import (Get lineage) feature might not be active. To properly install MANTA after the CPD upgrade, follow the below steps.

• Enable MANTA, Data Quality, and Knowledge Graph in WKC by running the following command.

cpd-cli manage update-cr \
--component=wkc \
--cpd_instance_ns=${PROJECT_CPD_INSTANCE} \
--patch="{\"install_wkc_core_only\":True,\"enableKnowledgeGraph\":True,\"enableMANTA\":True}"

1. Log in to the OpenShift console
2. Navigate to the Workloads section and then ConfigMaps
3. Delete the following config map: manta-route-flow-tls
4. Restart the manta-adl-operator-controller-manager pod
5. Verify that the manta-route-flow-tls has been created automatically
6. Ensure that the following line exists in the manta-dataflow-server configMaps’ Data section under nginx.conf.

access_by_lua_file /nginx_data/checkjwt.lua
proxy_pass https://$manta_server:8080