Untitled
unknown
plain_text
2 years ago
69 kB
5
Indexable
ayaror@ayaror0821mac ~ % k logs -f mappings-generator-parquet-cc527 W0411 16:45:28.839360 47334 gcp.go:119] WARNING: the gcp auth plugin is deprecated in v1.22+, unavailable in v1.26+; use gcloud instead. To learn more, consult https://cloud.google.com/blog/products/containers-kubernetes/kubectl-auth-changes-in-gke Launching jar against cluster identity-prod-spark-singlestore-a Getting access token... Checking for active cluster version... Active cluster version is 1 Using cluster version 1 Downloading configs... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 1147M 100 1147M 0 0 203M 0 0:00:05 0:00:05 --:--:-- 208M Unzipping configuration... Linking configuration... Linking to legacy symlink target... unlink: can't remove file '/etc/hadoop/conf.cloudera.yarn2': No such file or directory Running job WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. WARNING: DEFAULT_LIBEXEC_DIR ignored. It has been replaced by HADOOP_DEFAULT_LIBEXEC_DIR. WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/etc/hadoop-cloud/identity-prod-spark-singlestore-a/1/parcels/SPARK2/lib/spark2/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/etc/hadoop-cloud/identity-prod-spark-singlestore-a/1/parcels/CDH/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 23/04/11 16:40:07 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 23/04/11 16:40:07 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 23/04/11 16:40:10 INFO com.liveramp.cascading_ext.FileSystemHelper: Getting filesystem for path gs://identity-aim/prod took 1 attempts and 1684 milliseconds Tue Apr 11 16:40:10 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. Tue Apr 11 16:40:15 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest -151595566 request count: 2000 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465876731 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465875651 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465866041 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465862391 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465861171 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860721 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860521 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860421 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860321 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464762971 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464761931 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464759611 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464757881 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464752271 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464748121 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747701 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747481 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464746371 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745701 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745561 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464617351 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464612321 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464610231 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464584591 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464578581 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464566161 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464554991 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464551681 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464548441 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464545301 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464543561 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464519771 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464518011 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464515111 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464514181 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464513251 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464508821 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464506601 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464501501 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464497111 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464495131 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464493981 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464369051 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464361271 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464348571 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464337431 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464328011 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464320181 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464317331 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316211 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316081 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464315801 isn't assigned an aim config id! 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest -151595566 dedupedRequests count: 1 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: config digest -151595566 request: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:CRITICAL, max_age_in_secs:864000, rule:HOUSEHOLD_ABILITEC, owners:[8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true) 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest 1060926609 request count: 2000 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465876741 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465875661 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465866061 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465862401 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465861181 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860731 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860531 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860431 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1465860331 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464762981 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464761941 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464759621 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464757891 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464752301 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464748141 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747711 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464747491 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464746381 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745711 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464745571 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464617371 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464612351 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464610241 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464584601 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464578601 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464566211 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464555011 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464551691 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464548451 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464545311 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464543571 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464519781 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464518021 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464515121 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464514191 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464513261 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464508831 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464506611 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464501511 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464497121 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464495141 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464493991 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464369061 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464361281 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464348581 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464337451 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464328051 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464320191 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464317341 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316221 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464316091 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1464315821 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460339181 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460319671 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460318231 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460307301 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460288141 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460278171 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460274831 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460274411 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460273131 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460272941 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460272141 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460271621 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1460270551 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457455281 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457453981 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457448551 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457444001 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457439861 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457437101 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457434431 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457433081 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457431141 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457427991 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457416001 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457169841 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457156671 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457145461 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457133341 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457115261 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457111351 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457110441 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1457109081 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456798991 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456785711 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456777951 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456773691 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456767341 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456763571 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456762881 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456762561 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456761971 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456761481 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456760661 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456756901 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456754911 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456749451 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456747931 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456746241 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1456743921 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455430861 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455418001 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455404701 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455397681 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455395871 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455393701 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455392031 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391751 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391551 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1455391241 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447402881 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447400071 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447399231 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447393961 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447389201 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447388871 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447388231 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387951 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387521 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447387181 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447386941 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447383701 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447374471 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447372081 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371951 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371751 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371671 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371631 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447371611 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447243391 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447240131 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447238191 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447236491 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447234951 isn't assigned an aim config id! 23/04/11 16:40:16 WARN com.liveramp.aim_graph_builder_lib.aim.AimRequestHelper: Aim request with id 1447233071 isn't assigned an aim config id! 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: configDigest 1060926609 dedupedRequests count: 1 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: config digest 1060926609 request: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:CRITICAL, max_age_in_secs:864000, rule:INDIVIDUAL_ABILITEC, owners:[1026, 8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true) 23/04/11 16:40:16 WARN org.apache.spark.SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangEntityId: 6957251116 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: submitted AimRequest Id: 1465877831, submitted AimRequest: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:EXPERIMENTAL, max_age_in_secs:864000, rule:HOUSEHOLD_ABILITEC, owners:[8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true) 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangFormat: PARQUET 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangEntityId: 9346095526 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: submitted AimRequest Id: 1465877841, submitted AimRequest: AimRequest(source:IdentifierPool(identifier_type_id:6, pool_id:10936), target:IdentifierPool(identifier_type_id:6, pool_id:10936), priority:EXPERIMENTAL, max_age_in_secs:864000, rule:INDIVIDUAL_ABILITEC, owners:[1026, 8], requester:CREATE_CSV_FROM_AIM_MAPPING_FOFF, gcp:true) 23/04/11 16:40:16 INFO com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow: bangFormat: PARQUET 2023-04-11 16:40:16,763 INFO SmtpConfig (SmtpConfig.java:defaultConfig(62)) - SMTP user or password is null 2023-04-11 16:40:17,130 INFO HadoopUtil (HadoopUtil.java:findMainClass(325)) - resolving application jar from found main method on: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow 2023-04-11 16:40:17,354 INFO RunJarUtil (RunJarUtil.java:getLaunchJarURL(118)) - Found launch jar from classpath jars: file:/apps/ss_spark_connector/current/ss_spark_connector.job.jar 2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getScmInfoFromLaunchJar(92)) - Found SCM information: ScmInfo{gitRemote='null', revision='null'} 2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getRemoteAndCommit(59)) - Found SCM info: ScmInfo{gitRemote='null', revision='null'} 2023-04-11 16:40:17,357 INFO RunJarUtil (RunJarUtil.java:getLaunchJarURL(118)) - Found launch jar from classpath jars: file:/apps/ss_spark_connector/current/ss_spark_connector.job.jar Tue Apr 11 16:40:17 PDT 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 2023-04-11 16:40:17,599 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:getApplication(206)) - Using existing application 2023-04-11 16:40:17,599 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(82)) - Using application: <Application id: 126 name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow app_type: null> 2023-04-11 16:40:17,609 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:getOrCreateExecution(428)) - Found previous execution <WorkflowExecution.Attributes app_type: null name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow scope_identifier: Map_Upl status: 0 start_time: 1681255710000 end_time: null application_id: 126 pool_override: null> id 213926413 2023-04-11 16:40:17,609 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(85)) - Using workflow execution: <WorkflowExecution.Attributes app_type: null name: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow scope_identifier: Map_Upl status: 0 start_time: 1681255710000 end_time: null application_id: 126 pool_override: null> id 213926413 2023-04-11 16:40:17,622 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:cleanUpRunningAttempts(226)) - Found previous attempts: [] 2023-04-11 16:40:17,813 INFO DbPersistence (CoreWorkflowDbPersistenceFactory.java:initializeInternal(108)) - Using new attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: null end_time: null status: 6 last_heartbeat: 1681256417646 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646> id 218694760 2023-04-11 16:40:17,973 INFO StepExecutor (StepExecutor.java:doRun(204)) - Started: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl) 2023-04-11 16:40:18,006 INFO DbPersistence (DbPersistence.java:markWorkflowStarted(358)) - Starting attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: null end_time: null status: 6 last_heartbeat: 1681256418000 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646> 2023-04-11 16:40:18,035 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877831 as running 2023-04-11 16:40:18,051 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__wait-for-prod-store-1465877831 2023-04-11 16:40:18,053 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877841 as running 2023-04-11 16:40:18,065 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__wait-for-prod-store-1465877841 2023-04-11 16:40:18,071 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:18,071 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:18,083 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:18,084 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:18,084 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877831 as completed 2023-04-11 16:40:18,095 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__wait-for-prod-store-1465877841 as completed 2023-04-11 16:40:24,089 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__lookup-version-1465877831 as running 2023-04-11 16:40:24,099 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__lookup-version-1465877831 2023-04-11 16:40:24,100 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__lookup-version-1465877841 as running 2023-04-11 16:40:24,111 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__lookup-version-1465877841 2023-04-11 16:40:24,118 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:24,118 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:24,119 INFO LookUpMappings (LookUpMappings.java:execute(47)) - Getting version from AIM... 2023-04-11 16:40:24,119 INFO LookUpMappings (LookUpMappings.java:execute(48)) - requestId: 1465877841 2023-04-11 16:40:24,125 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:24,125 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:24,126 INFO LookUpMappings (LookUpMappings.java:execute(47)) - Getting version from AIM... 2023-04-11 16:40:24,127 INFO LookUpMappings (LookUpMappings.java:execute(48)) - requestId: 1465877831 2023-04-11 16:40:24,146 INFO ReconnectingThriftClient (ReconnectingThriftClient.java:handleRetryableException(185)) - Retrying after exception: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179) at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172) at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source) at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217) at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140) at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65) at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404) at java.lang.Thread.run(Thread.java:748) Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: java.io.IOException: Stream closed at com.liveramp.org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:147) at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100) at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505) at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712) ... 14 more Caused by: java.io.IOException: Stream closed at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:170) at java.io.BufferedInputStream.read(BufferedInputStream.java:336) at com.liveramp.org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ... 23 more 2023-04-11 16:40:24,146 ERROR BaseAction (BaseAction.java:internalExecute(225)) - Action aim_mappings_generator__lookup-version-1465877841 failed due to Throwable com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137) at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100) at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505) at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179) at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172) at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source) at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217) at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140) at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65) at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404) at java.lang.Thread.run(Thread.java:748) 2023-04-11 16:40:24,154 ERROR StepExecutor (StepExecutor.java:run(413)) - Step aim_mappings_generator__lookup-version-1465877841 failed! java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226) at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140) at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65) at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404) at java.lang.Thread.run(Thread.java:748) Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137) at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100) at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505) at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179) at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172) at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source) at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217) ... 4 more 2023-04-11 16:40:24,157 INFO DbPersistence (DbPersistence.java:markStepFailed(136)) - Marking step aim_mappings_generator__lookup-version-1465877841 as failed 2023-04-11 16:40:24,389 ERROR MailerHelper (MailerHelper.java:lambda$mail$0(172)) - Exception sending message javax.mail.MessagingException: Unknown SMTP host: mail.liveramp.net; nested exception is: java.net.UnknownHostException: mail.liveramp.net at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1970) at com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:642) at javax.mail.Service.connect(Service.java:295) at javax.mail.Service.connect(Service.java:176) at javax.mail.Service.connect(Service.java:196) at com.liveramp.java_support.alerts_handler.MailerHelper.lambda$mail$0(MailerHelper.java:168) at com.liveramp.java_support.concurrent.ParallelUtil.lambda$runWithTimeout$1(ParallelUtil.java:195) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.UnknownHostException: mail.liveramp.net at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at com.sun.mail.util.SocketFetcher.createSocket(SocketFetcher.java:319) at com.sun.mail.util.SocketFetcher.getSocket(SocketFetcher.java:233) at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1938) ... 10 more 2023-04-11 16:40:24,390 INFO MailerHelperAlertsHandler (MailerHelperAlertsHandler.java:sendEmail(81)) - Alert email contents: To:[Engineering{error}] Subject:[ERROR] [MappingsUploaderWorkflow] [WORKFLOW] Step has failed in: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl) Tracker URL: //http://workflows.liveramp.net/workflow.html?id=218694760<br><br>Workflow will continue running non-blocked steps <br /><br /> Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! 2023-04-11 16:40:39,176 INFO LookUpMappings (LookUpMappings.java:execute(52)) - aimVersion: 1680795860 2023-04-11 16:40:39,196 INFO LookUpMappings (LookUpMappings.java:execute(58)) - vcVersion: 1680795860 | aimVersion: 1680795860 for bangEntityId 6957251116 2023-04-11 16:40:39,280 INFO DbStorage (BaseDbStorage.java:store(67)) - Stored resource 'newVersionCreated-1' to root <ResourceRoot id: 111057491 name: null created_at: 1681255710000 updated_at: 1681255710000 scope_identifier: null version: 213926413 version_type: com.liveramp.workflow_db_state.InitializedDbPersistence> 2023-04-11 16:40:39,282 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__lookup-version-1465877831 as completed 2023-04-11 16:40:42,154 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__upload-1465877831-PARQUET as running 2023-04-11 16:40:42,163 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__upload-1465877831-PARQUET 2023-04-11 16:40:42,221 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 2023-04-11 16:40:42,222 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 2023-04-11 16:40:42,927 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering MapOutputTracker 2023-04-11 16:40:42,975 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering BlockManagerMaster 2023-04-11 16:40:43,056 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering BlockManagerMasterHeartbeat 2023-04-11 16:40:43,177 INFO SparkEnv (Logging.scala:logInfo(57)) - Registering OutputCommitCoordinator 2023-04-11 16:40:43,336 INFO log (Log.java:initialized(169)) - Logging initialized @37622ms to org.sparkproject.jetty.util.log.Slf4jLog 2023-04-11 16:40:43,452 INFO Server (Server.java:doStart(375)) - jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 1.8.0_212-b04 2023-04-11 16:40:43,488 INFO Server (Server.java:doStart(415)) - Started @37774ms 2023-04-11 16:40:43,557 INFO AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@1191238f{HTTP/1.1, (http/1.1)}{0.0.0.0:36937} 2023-04-11 16:40:44,495 INFO RMProxy (RMProxy.java:newProxyInstance(134)) - Connecting to ResourceManager at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:8032 2023-04-11 16:40:44,738 INFO AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:10200 2023-04-11 16:40:45,055 INFO Configuration (Configuration.java:getConfResourceAsInputStream(2795)) - resource-types.xml not found 2023-04-11 16:40:45,056 INFO ResourceUtils (ResourceUtils.java:addResourcesFileToConf(442)) - Unable to find 'resource-types.xml'. 2023-04-11 16:40:46,985 INFO YarnClientImpl (YarnClientImpl.java:submitApplication(329)) - Submitted application application_1675968800999_0127 2023-04-11 16:40:48,057 WARN SparkConf (Logging.scala:logWarning(69)) - The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 2023-04-11 16:40:48,074 INFO RMProxy (RMProxy.java:newProxyInstance(134)) - Connecting to ResourceManager at identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal/10.115.49.47:8030 2023-04-11 16:40:49,424 INFO GoogleCloudStorageImpl (AbstractBackend.java:log(101)) - Ignoring exception of type GoogleJsonResponseException; verified object already exists with desired state. 2023-04-11 16:40:50,217 INFO BaseAction (BaseAction.java:setStatusMessage(265)) - Status Message: <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127</a> 2023-04-11 16:40:50,217 INFO DbPersistence (DbPersistence.java:markStepStatusMessage(213)) - Marking step status message: aim_mappings_generator__upload-1465877831-PARQUET message <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:8088/proxy/application_1675968800999_0127</a> 2023-04-11 16:40:50,227 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:50,227 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:50,231 INFO DbStorage (BaseDbStorage.java:retrieve(89)) - Retrieved resource 'newVersionCreated-1' from the cache 2023-04-11 16:40:50,232 INFO UploadMappingAndUpdateInVC (UploadMappingAndUpdateInVC.java:execute(68)) - Skip new version generation/uploading 2023-04-11 16:40:50,233 INFO BaseAction (BaseAction.java:setStatusMessage(265)) - Status Message: <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs</a> 2023-04-11 16:40:50,234 INFO DbPersistence (DbPersistence.java:markStepStatusMessage(213)) - Marking step status message: aim_mappings_generator__upload-1465877831-PARQUET message <a href=http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs>http://identity-prod-spark-singlestore-a-1-m.c.liveramp-eng-identity.internal:18080/history/application_1675968800999_0127/jobs</a> 2023-04-11 16:40:50,254 INFO AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped Spark@1191238f{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-04-11 16:40:50,887 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__upload-1465877831-PARQUET as completed 2023-04-11 16:40:54,209 INFO DbPersistence (DbPersistence.java:markStepRunning(123)) - Marking step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831 as running 2023-04-11 16:40:54,209 INFO StepExecutor (StepExecutor.java:doRun(281)) - Removing shutdown hook 2023-04-11 16:40:54,217 INFO StepExecutor (StepExecutor.java:run(403)) - Executing step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831 2023-04-11 16:40:54,221 INFO BaseAction (BaseAction.java:internalExecute(207)) - Setting read resources 2023-04-11 16:40:54,222 INFO BaseAction (BaseAction.java:internalExecute(212)) - Setting write resources 2023-04-11 16:40:54,224 INFO DbStorage (BaseDbStorage.java:retrieve(89)) - Retrieved resource 'newVersionCreated-1' from the cache 2023-04-11 16:40:54,225 INFO UpdateAndReportAIMStats (UpdateAndReportAIMStats.java:execute(63)) - newVersionIsCreated in UpdateVCStatus: false 2023-04-11 16:40:54,226 INFO UpdateAndReportAIMStats (UpdateAndReportAIMStats.java:execute(66)) - Skip stats reporting 2023-04-11 16:40:54,226 INFO DbPersistence (DbPersistence.java:markStepCompleted(160)) - Marking step aim_mappings_generator__report_aim_stats_update_aim_stats_on_disk_1465877831 as completed 2023-04-11 16:40:54,249 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(65)) - Marking workflow stopped 2023-04-11 16:40:54,260 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(86)) - Stopping attempt: <WorkflowAttempt id: 218694760 workflow_execution_id: 213926413 system_user: root shutdown_reason: null priority: NORMAL pool: root.identity.oi_oneoff host: mappings-generator-parquet-cc527 start_time: 1681256418000 end_time: 1681256454250 status: 1 last_heartbeat: 1681256418000 launch_dir: /apps/ss_spark_connector/current launch_jar: ss_spark_connector.job.jar error_email: ayush.arora@liveramp.com info_email: ayush.arora@liveramp.com scm_remote: null commit_revision: null description: null last_heartbeat_epoch: 1681256417646> 2023-04-11 16:40:54,260 INFO InitializedDbPersistence (InitializedDbPersistence.java:markWorkflowStopped(100)) - Marking status of attempt 218694760 as 3 2023-04-11 16:40:54,268 INFO InitializedDbPersistence (InitializedDbPersistence.java:run(181)) - Heartbeat thread killed 2023-04-11 16:40:54,329 ERROR MailerHelper (MailerHelper.java:lambda$mail$0(172)) - Exception sending message javax.mail.MessagingException: Unknown SMTP host: mail.liveramp.net; nested exception is: java.net.UnknownHostException: mail.liveramp.net at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1970) at com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:642) at javax.mail.Service.connect(Service.java:295) at javax.mail.Service.connect(Service.java:176) at javax.mail.Service.connect(Service.java:196) at com.liveramp.java_support.alerts_handler.MailerHelper.lambda$mail$0(MailerHelper.java:168) at com.liveramp.java_support.concurrent.ParallelUtil.lambda$runWithTimeout$1(ParallelUtil.java:195) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.UnknownHostException: mail.liveramp.net at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at com.sun.mail.util.SocketFetcher.createSocket(SocketFetcher.java:319) at com.sun.mail.util.SocketFetcher.getSocket(SocketFetcher.java:233) at com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1938) ... 10 more 2023-04-11 16:40:54,329 INFO MailerHelperAlertsHandler (MailerHelperAlertsHandler.java:sendEmail(81)) - Alert email contents: To:[Engineering{error}] Subject:[ERROR] [MappingsUploaderWorkflow] [WORKFLOW] Failed: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl) Tracker URL: //http://workflows.liveramp.net/workflow.html?id=218694760<br><br>(1/1) Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br />java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br /> at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256)<br /> at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226)<br /> at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140)<br /> at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65)<br /> at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404)<br /> at java.lang.Thread.run(Thread.java:748)<br />Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)!<br /> at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137)<br /> at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100)<br /> at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)<br /> at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637)<br /> at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505)<br /> at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)<br /> at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725)<br /> at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<br /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br /> at java.lang.reflect.Method.invoke(Method.java:498)<br /> at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179)<br /> at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261)<br /> at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172)<br /> at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source)<br />at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50)<br /> at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217)<br /> ... 4 more<br /><br /> 2023-04-11 16:40:54,338 INFO BaseWorkflowRunner (BaseWorkflowRunner.java:run(229)) - Removing shutdown hook 2023-04-11 16:40:54,338 INFO WorkflowRunner (WorkflowRunner.java:shutdown(122)) - Shutting down lock provider 2023-04-11 16:40:54,375 INFO BaseWorkflowRunner (BaseWorkflowRunner.java:run(232)) - Timing statistics: aim_mappings_generator: wait-for-prod-store-1465877831:0 seconds (start: 1681256418000 end: 1681256418000) wait-for-prod-store-1465877841:0 seconds (start: 1681256418000 end: 1681256418000) lookup-version-1465877831:15 seconds (start: 1681256424000 end: 1681256439000) lookup-version-1465877841:0 seconds (start: 1681256424000 end: 1681256424000) upload-1465877831-PARQUET:9 seconds (start: 1681256442000 end: 1681256451000) upload-1465877841-PARQUET:0 seconds (start: 0 end: 0) report_aim_stats_update_aim_stats_on_disk_1465877831:0 seconds (start: 1681256454000 end: 1681256454000) report_aim_stats_update_aim_stats_on_disk_1465877841:0 seconds (start: 0 end: 0) Exception in thread "main" java.lang.RuntimeException: Failed: com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow (Map_Upl) (1/1) Step aim_mappings_generator__lookup-version-1465877841 failed with exception: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! java.lang.RuntimeException: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! at com.liveramp.workflow_core.runner.BaseAction.wrapRuntimeException(BaseAction.java:256) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:226) at com.liveramp.workflow_core.runner.BaseStep.run(BaseStep.java:140) at com.rapleaf.cascading_ext.workflow2.strategy.ExecuteStrategy.run(ExecuteStrategy.java:65) at com.rapleaf.cascading_ext.workflow2.StepExecutor$StepRunner$1.run(StepExecutor.java:404) at java.lang.Thread.run(Thread.java:748) Caused by: com.liveramp.org.apache.thrift.transport.TTransportException: Read a negative frame size (-2107571428)! at com.liveramp.org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137) at com.liveramp.org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:100) at com.liveramp.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:637) at com.liveramp.org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:505) at com.liveramp.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.recv_get_aim_record_store_version(AimConfigCoordinator.java:725) at com.liveramp.types.anonymous_identifier_mapping.AimConfigCoordinator$Client.get_aim_record_store_version(AimConfigCoordinator.java:712) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy$1.run(ReconnectingThriftClient.java:179) at com.liveramp.consul.ReconnectingThriftClient$RetryHelper.runWithRetry(ReconnectingThriftClient.java:261) at com.liveramp.consul.ReconnectingThriftClient$ReconnectingClientProxy.invoke(ReconnectingThriftClient.java:172) at com.sun.proxy.$Proxy5.get_aim_record_store_version(Unknown Source) at com.liveramp.ss_spark_connector.scripts.mapping_generation.LookUpMappings.execute(LookUpMappings.java:50) at com.liveramp.workflow_core.runner.BaseAction.internalExecute(BaseAction.java:217) ... 4 more at com.rapleaf.cascading_ext.workflow2.StepExecutor.doRun(StepExecutor.java:312) at com.rapleaf.cascading_ext.workflow2.BaseWorkflowRunner.run(BaseWorkflowRunner.java:218) at com.liveramp.liveramp_hlib.OneoffWorkflowRunner.runOneoff(OneoffWorkflowRunner.java:89) at com.liveramp.ss_spark_connector.cron.MappingsUploaderWorkflow.main(MappingsUploaderWorkflow.java:302) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1039) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1048) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Editor is loading...