Untitled
unknown
plain_text
2 years ago
69 kB
5
Indexable
ayaror@ayaror0821mac ~ % k logs -f mappings-generator-parquet-cc527
W0411 16:45:28.839360 47334 gcp.go:119] WARNING: the gcp auth plugin is deprecated in v1.22+, unavailable in v1.26+; use gcloud instead.
To learn more, consult https://cloud.google.com/blog/products/containers-kubernetes/kubectl-auth-changes-in-gke
Launching jar against cluster identity-prod-spark-singlestore-a
Getting access token...
Checking for active cluster version...
Active cluster version is 1
Using cluster version 1
Downloading configs...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1147M 100 1147M 0 0 203M 0 0:00:05 0:00:05 --:--:-- 208M
Unzipping configuration...
Linking configuration...
Linking to legacy symlink target...
unlink: can't remove file '/etc/hadoop/conf.cloudera.yarn2': No such file or directory
Running job
WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.
WARNING: DEFAULT_LIBEXEC_DIR ignored. It has been replaced by HADOOP_DEFAULT_LIBEXEC_DIR.
WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/etc/hadoop-cloud/identity-prod-spark-singlestore-a/1/parcels/SPARK2/lib/spark2/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/etc/hadoop-cloud/identity-prod-spark-singlestore-a/1/parcels/CDH/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
23/04/11 16:40:07 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
23/04/11 16:40:07 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
23/04/11 16:40:10 INFO com.liveramp.cascading_ext.FileSystemHelper: Getting filesystem for path gs://identity-aim/prod took 1 attempts and 1684 milliseconds
Tue Apr 11 16:40:10 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Tue Apr 11 16:40:15 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest -151595566 request count: 2000
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465876731 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465875651 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465866041 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465862391 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465861171 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860721 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860521 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860421 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860321 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464762971 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464761931 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464759611 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464757881 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464752271 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464748121 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747701 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747481 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464746371 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745701 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745561 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464617351 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464612321 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464610231 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464584591 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464578581 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464566161 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464554991 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464551681 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464548441 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464545301 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464543561 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464519771 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464518011 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464515111 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464514181 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464513251 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464508821 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464506601 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464501501 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464497111 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464495131 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464493981 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464369051 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464361271 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464348571 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464337431 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464328011 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464320181 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464317331 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316211 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316081 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464315801 isn't assigned an aim config id!
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest -151595566 dedupedRequests count: 1
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: config digest -151595566 request: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:CRITICAL, max_age_in_secs:864000, rule:HOUSEHOLD_ABILITEC, owners:[8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true)
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest 1060926609 request count: 2000
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465876741 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465875661 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465866061 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465862401 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465861181 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860731 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860531 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860431 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860331 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464762981 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464761941 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464759621 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464757891 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464752301 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464748141 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747711 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747491 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464746381 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745711 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745571 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464617371 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464612351 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464610241 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464584601 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464578601 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464566211 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464555011 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464551691 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464548451 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464545311 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464543571 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464519781 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464518021 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464515121 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464514191 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464513261 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464508831 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464506611 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464501511 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464497121 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464495141 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464493991 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464369061 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464361281 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464348581 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464337451 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464328051 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464320191 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464317341 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316221 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316091 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464315821 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460339181 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460319671 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460318231 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460307301 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460288141 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460278171 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460274831 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460274411 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460273131 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460272941 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460272141 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460271621 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460270551 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457455281 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457453981 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457448551 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457444001 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457439861 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457437101 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457434431 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457433081 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457431141 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457427991 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457416001 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457169841 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457156671 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457145461 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457133341 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457115261 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457111351 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457110441 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457109081 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456798991 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456785711 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456777951 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456773691 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456767341 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456763571 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456762881 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456762561 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456761971 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456761481 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456760661 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456756901 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456754911 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456749451 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456747931 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456746241 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456743921 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455430861 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455418001 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455404701 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455397681 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455395871 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455393701 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455392031 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391751 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391551 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391241 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447402881 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447400071 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447399231 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447393961 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447389201 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447388871 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447388231 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387951 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387521 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387181 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447386941 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447383701 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447374471 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447372081 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371951 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371751 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371671 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371631 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371611 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447243391 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447240131 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447238191 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447236491 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447234951 isn't assigned an aim config id!
23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447233071 isn't assigned an aim config id!
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest 1060926609 dedupedRequests count: 1
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: config digest 1060926609 request: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:CRITICAL, max_age_in_secs:864000, rule:INDIVIDUAL_ABILITEC, owners:[1026, 8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true)
23/04/11 16:40:16 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangEntityId: 6957251116
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: submitted AimRequest Id: 1465877831, submitted AimRequest: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:EXPERIMENTAL, max_age_in_secs:864000, rule:HOUSEHOLD_ABILITEC, owners:[8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true)
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangFormat: PARQUET
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangEntityId: 9346095526
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: submitted AimRequest Id: 1465877841, submitted AimRequest: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:EXPERIMENTAL, max_age_in_secs:864000, rule:INDIVIDUAL_ABILITEC, owners:[1026, 8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true)
23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangFormat: PARQUET
2023-04-11 16:40:16,763 INFO SmtpConfig (SmtpConfig.java:defaultConfig(62)) - SMTP user or password is null
2023-04-11 16:40:17,130 INFO HadoopUtil (HadoopUtil.java:findMainClass(325)) - resolving application jar from found main method on: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow
2023-04-11 16:40:17,354 INFO RunJarUtil (RunJarUtil.java:getLaunchJarURL(118)) - Found launch jar from classpath jars: file:/apps/ss_spark_connector/current/ss_spark_connector.job.jar
2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getScmInfoFromLaunchJar(92)) - Found SCM information: ScmInfo{gitRemote='null', revision='null'}
2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getRemoteAndCommit(59)) - Found SCM info: ScmInfo{gitRemote='null', revision='null'}
2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getLaunchJarURL(118)) - Found launch jar from classpath jars: file:/apps/ss_spark_connector/current/ss_spark_connector.job.jar
Tue Apr 11 16:40:17 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-04-11 16:40:17,599 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:getApplication(206)) - Using existing application
2023-04-11 16:40:17,599 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(82)) - Using application: <Application id: 126 name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow app_type: null>
2023-04-11 16:40:17,609 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:getOrCreateExecution(428)) - Found previous execution <WorkflowExecution.Attributes app_type: null name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow scope_identifier: Map_Upl status: 0 start_time: 1681255710000 end_time: null application_id: 126 pool_override: null> id 213926413
2023-04-11 16:40:17,609 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(85)) - Using workflow execution: <WorkflowExecution.Attributes app_type: null name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow scope_identifier: Map_Upl status: 0 start_time: 1681255710000 end_time: null application_id: 126 pool_override: null> id 213926413
2023-04-11 16:40:17,622 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:cleanUpRunningAttempts(226)) - Found previous attempts: []
2023-04-11 16:40:17,813 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(108)) - Using new attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: null end_time: null status: 6 last_heartbeat: 1681256417646 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646> id 218694760
2023-04-11 16:40:17,973 INFO StepExecutor (StepExecutor.java:doRun(204)) - Started: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl)
2023-04-11 16:40:18,006 INFO DbPersistence (DbPersistence.java:markWorkflowStarted(358)) - Starting attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: null end_time: null status: 6 last_heartbeat: 1681256418000 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646>
2023-04-11 16:40:18,035 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877831 as running
2023-04-11 16:40:18,051 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__wait-for-prod-store-1465877831
2023-04-11 16:40:18,053 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877841 as running
2023-04-11 16:40:18,065 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__wait-for-prod-store-1465877841
2023-04-11 16:40:18,071 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:18,071 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:18,083 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:18,084 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:18,084 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877831 as completed
2023-04-11 16:40:18,095 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877841 as completed
2023-04-11 16:40:24,089 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__lookup-version-1465877831 as running
2023-04-11 16:40:24,099 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__lookup-version-1465877831
2023-04-11 16:40:24,100 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__lookup-version-1465877841 as running
2023-04-11 16:40:24,111 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__lookup-version-1465877841
2023-04-11 16:40:24,118 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:24,118 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:24,119 INFO LookUpMappings (LookUpMappings.java:execute(47)) - Getting version from AIM...
2023-04-11 16:40:24,119 INFO LookUpMappings (LookUpMappings.java:execute(48)) - requestId: 1465877841
2023-04-11 16:40:24,125 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:24,125 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:24,126 INFO LookUpMappings (LookUpMappings.java:execute(47)) - Getting version from AIM...
2023-04-11 16:40:24,127 INFO LookUpMappings (LookUpMappings.java:execute(48)) - requestId: 1465877831
2023-04-11 16:40:24,146 INFO ReconnectingThriftClient (ReconnectingThriftClient.java:handleRetryableException(185)) - Retrying after exception:
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)
at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)
at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)
at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)
at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)
at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)
at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: java.io.IOException: Stream closed
at com.liveramp.org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:147)
at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)
at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)
at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)
... 14 more
Caused by: java.io.IOException: Stream closed
at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:170)
at java.io.BufferedInputStream.read(BufferedInputStream.java:336)
at com.liveramp.org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
2023-04-11 16:40:24,146 ERROR BaseAction (BaseAction.java:internalExecute(225)) - Action aim_mappings_generator__lookup-version-1465877841 failed due to Throwable
com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)
at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)
at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)
at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)
at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)
at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)
at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)
at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)
at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)
at java.lang.Thread.run(Thread.java:748)
2023-04-11 16:40:24,154 ERROR StepExecutor (StepExecutor.java:run(413)) - Step aim_mappings_generator__lookup-version-1465877841 failed!
java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226)
at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)
at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)
at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)
at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)
at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)
at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)
at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)
at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)
... 4 more
2023-04-11 16:40:24,157 INFO DbPersistence (DbPersistence.java:markStepFailed(136)) - Marking step aim_mappings_generator__lookup-version-1465877841 as failed
2023-04-11 16:40:24,389 ERROR MailerHelper (MailerHelper.java:lambda$mail$0(172)) - Exception sending message
javax.mail.MessagingException: Unknown SMTP host: mail.liveramp.net;
nested exception is:
java.net.UnknownHostException: mail.liveramp.net
at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1970)
at com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:642)
at javax.mail.Service.connect(Service.java:295)
at javax.mail.Service.connect(Service.java:176)
at javax.mail.Service.connect(Service.java:196)
at com.liveramp.java_support.alerts_handler.MailerHelper.lambda$mail$0(MailerHelper.java:168)
at com.liveramp.java_support.concurrent.ParallelUtil.lambda$runWithTimeout$1(ParallelUtil.java:195)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException: mail.liveramp.net
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at java.net.Socket.connect(Socket.java:538)
at com.sun.mail.util.SocketFetcher.createSocket(SocketFetcher.java:319)
at com.sun.mail.util.SocketFetcher.getSocket(SocketFetcher.java:233)
at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1938)
... 10 more
2023-04-11 16:40:24,390 INFO MailerHelperAlertsHandler (MailerHelperAlertsHandler.java:sendEmail(81)) - Alert email contents:
To:[Engineering{error}]
Subject:[ERROR] [MappingsUploaderWorkflow] [WORKFLOW] Step has failed in: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl)
Tracker URL: //http://workflows.liveramp.net/workflow.html?id=218694760<br><br>Workflow will continue running non-blocked steps <br /><br /> Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
2023-04-11 16:40:39,176 INFO LookUpMappings (LookUpMappings.java:execute(52)) - aimVersion: 1680795860
2023-04-11 16:40:39,196 INFO LookUpMappings (LookUpMappings.java:execute(58)) - vcVersion: 1680795860 | aimVersion: 1680795860 for bangEntityId 6957251116
2023-04-11 16:40:39,280 INFO DbStorage (BaseDbStorage.java:store(67)) - Stored resource 'newVersionCreated-1' to root <ResourceRoot id: 111057491 name: null created_at: 1681255710000 updated_at: 1681255710000 scope_identifier: null version: 213926413 version_type: com.liveramp.workflow_db_state.InitializedDbPersistence>
2023-04-11 16:40:39,282 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__lookup-version-1465877831 as completed
2023-04-11 16:40:42,154 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__upload-1465877831-PARQUET as running
2023-04-11 16:40:42,163 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__upload-1465877831-PARQUET
2023-04-11 16:40:42,221 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
2023-04-11 16:40:42,222 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
2023-04-11 16:40:42,927 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering MapOutputTracker
2023-04-11 16:40:42,975 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering BlockManagerMaster
2023-04-11 16:40:43,056 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering BlockManagerMasterHeartbeat
2023-04-11 16:40:43,177 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering OutputCommitCoordinator
2023-04-11 16:40:43,336 INFO log (Log.java:initialized(169)) - Logging initialized @37622ms to org.sparkproject.jetty.util.log.Slf4jLog
2023-04-11 16:40:43,452 INFO Server (Server.java:doStart(375)) - jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 1.8.0_212-b04
2023-04-11 16:40:43,488 INFO Server (Server.java:doStart(415)) - Started @37774ms
2023-04-11 16:40:43,557 INFO AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@1191238f{HTTP/1.1, (http/1.1)}{0.0.0.0:36937}
2023-04-11 16:40:44,495 INFO RMProxy (RMProxy.java:newProxyInstance(134)) - Connecting to ResourceManager at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:8032
2023-04-11 16:40:44,738 INFO AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:10200
2023-04-11 16:40:45,055 INFO Configuration (Configuration.java:getConfResourceAsInputStream(2795)) - resource-types.xml not found
2023-04-11 16:40:45,056 INFO ResourceUtils (ResourceUtils.java:addResourcesFileToConf(442)) - Unable to find 'resource-types.xml'.
2023-04-11 16:40:46,985 INFO YarnClientImpl (YarnClientImpl.java:submitApplication(329)) - Submitted application application_1675968800999_0127
2023-04-11 16:40:48,057 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
2023-04-11 16:40:48,074 INFO RMProxy (RMProxy.java:newProxyInstance(134)) - Connecting to ResourceManager at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:8030
2023-04-11 16:40:49,424 INFO GoogleCloudStorageImpl (AbstractBackend.java:log(101)) - Ignoring exception of type GoogleJsonResponseException; verified object already exists with desired state.
2023-04-11 16:40:50,217 INFO BaseAction (BaseAction.java:setStatusMessage(265)) - Status Message: <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127</a>
2023-04-11 16:40:50,217 INFO DbPersistence (DbPersistence.java:markStepStatusMessage(213)) - Marking step status message: aim_mappings_generator__upload-1465877831-PARQUET message <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127</a>
2023-04-11 16:40:50,227 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:50,227 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:50,231 INFO DbStorage (BaseDbStorage.java:retrieve(89)) - Retrieved resource 'newVersionCreated-1' from the cache
2023-04-11 16:40:50,232 INFO UploadMappingAndUpdateInVC (UploadMappingAndUpdateInVC.java:execute(68)) - Skip new version generation/uploading
2023-04-11 16:40:50,233 INFO BaseAction (BaseAction.java:setStatusMessage(265)) - Status Message: <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs</a>
2023-04-11 16:40:50,234 INFO DbPersistence (DbPersistence.java:markStepStatusMessage(213)) - Marking step status message: aim_mappings_generator__upload-1465877831-PARQUET message <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs</a>
2023-04-11 16:40:50,254 INFO AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped Spark@1191238f{HTTP/1.1, (http/1.1)}{0.0.0.0:0}
2023-04-11 16:40:50,887 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__upload-1465877831-PARQUET as completed
2023-04-11 16:40:54,209 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831 as running
2023-04-11 16:40:54,209 INFO StepExecutor (StepExecutor.java:doRun(281)) - Removing shutdown hook
2023-04-11 16:40:54,217 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831
2023-04-11 16:40:54,221 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources
2023-04-11 16:40:54,222 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources
2023-04-11 16:40:54,224 INFO DbStorage (BaseDbStorage.java:retrieve(89)) - Retrieved resource 'newVersionCreated-1' from the cache
2023-04-11 16:40:54,225 INFO UpdateAndReportAIMStats (UpdateAndReportAIMStats.java:execute(63)) - newVersionIsCreated in UpdateVCStatus: false
2023-04-11 16:40:54,226 INFO UpdateAndReportAIMStats (UpdateAndReportAIMStats.java:execute(66)) - Skip stats reporting
2023-04-11 16:40:54,226 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831 as completed
2023-04-11 16:40:54,249 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(65)) - Marking workflow stopped
2023-04-11 16:40:54,260 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(86)) - Stopping attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: 1681256418000 end_time: 1681256454250 status: 1 last_heartbeat: 1681256418000 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646>
2023-04-11 16:40:54,260 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(100)) - Marking status of attempt 218694760 as 3
2023-04-11 16:40:54,268 INFO InitializedDbPersistence (InitializedDbPersistence.java:run(181)) - Heartbeat thread killed
2023-04-11 16:40:54,329 ERROR MailerHelper (MailerHelper.java:lambda$mail$0(172)) - Exception sending message
javax.mail.MessagingException: Unknown SMTP host: mail.liveramp.net;
nested exception is:
java.net.UnknownHostException: mail.liveramp.net
at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1970)
at com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:642)
at javax.mail.Service.connect(Service.java:295)
at javax.mail.Service.connect(Service.java:176)
at javax.mail.Service.connect(Service.java:196)
at com.liveramp.java_support.alerts_handler.MailerHelper.lambda$mail$0(MailerHelper.java:168)
at com.liveramp.java_support.concurrent.ParallelUtil.lambda$runWithTimeout$1(ParallelUtil.java:195)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException: mail.liveramp.net
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at java.net.Socket.connect(Socket.java:538)
at com.sun.mail.util.SocketFetcher.createSocket(SocketFetcher.java:319)
at com.sun.mail.util.SocketFetcher.getSocket(SocketFetcher.java:233)
at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1938)
... 10 more
2023-04-11 16:40:54,329 INFO MailerHelperAlertsHandler (MailerHelperAlertsHandler.java:sendEmail(81)) - Alert email contents:
To:[Engineering{error}]
Subject:[ERROR] [MappingsUploaderWorkflow] [WORKFLOW] Failed: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl)
Tracker URL: //http://workflows.liveramp.net/workflow.html?id=218694760<br><br>(1/1) Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br />java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br /> at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256)<br /> at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226)<br /> at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)<br /> at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)<br /> at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)<br /> at java.lang.Thread.run(Thread.java:748)<br />Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br /> at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137)<br /> at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)<br /> at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)<br /> at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)<br /> at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)<br /> at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)<br /> at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)<br /> at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<br /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br /> at java.lang.reflect.Method.invoke(Method.java:498)<br /> at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)<br /> at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)<br /> at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)<br /> at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)<br />at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)<br /> at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)<br /> ... 4 more<br /><br />
2023-04-11 16:40:54,338 INFO BaseWorkflowRunner (BaseWorkflowRunner.java:run(229)) - Removing shutdown hook
2023-04-11 16:40:54,338 INFO WorkflowRunner (WorkflowRunner.java:shutdown(122)) - Shutting down lock provider
2023-04-11 16:40:54,375 INFO BaseWorkflowRunner (BaseWorkflowRunner.java:run(232)) - Timing statistics:
aim_mappings_generator:
wait-for-prod-store-1465877831:0 seconds (start: 1681256418000 end: 1681256418000)
wait-for-prod-store-1465877841:0 seconds (start: 1681256418000 end: 1681256418000)
lookup-version-1465877831:15 seconds (start: 1681256424000 end: 1681256439000)
lookup-version-1465877841:0 seconds (start: 1681256424000 end: 1681256424000)
upload-1465877831-PARQUET:9 seconds (start: 1681256442000 end: 1681256451000)
upload-1465877841-PARQUET:0 seconds (start: 0 end: 0)
report_aim_stats_update_aim_stats_on_disk_1465877831:0 seconds (start: 1681256454000 end: 1681256454000)
report_aim_stats_update_aim_stats_on_disk_1465877841:0 seconds (start: 0 end: 0)
Exception in thread "main" java.lang.RuntimeException: Failed: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl)
(1/1) Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226)
at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)
at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)
at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!
at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)
at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)
at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)
at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)
at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)
at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)
at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)
at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)
at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)
at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)
... 4 more
at com.rapleaf.cascading_ext.workflow2.StepExecutor.doRun(StepExecutor.java:312)
at com.rapleaf.cascading_ext.workflow2.BaseWorkflowRunner.run(BaseWorkflowRunner.java:218)
at com.liveramp.liveramp_hlib.OneoffWorkflowRunner.runOneoff(OneoffWorkflowRunner.java:89)
at com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow.main(MappingsUploaderWorkflow.java:302)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1039)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1048)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)Editor is loading...