Untitled

mail@pastecode.io avatar
unknown
plain_text
a year ago
4.0 kB
4
Indexable
Never
> source('~/Luca/job1.R')
Deleted /appoLuca/out
packageJobJar: [/tmp/hadoop-unjar5561489735664231513/] [] /tmp/streamjob8211371644944017615.jar tmpDir=null
2023-03-07 17:58:15,917 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032
2023-03-07 17:58:16,536 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032
2023-03-07 17:58:17,163 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1678175622254_0018
2023-03-07 17:58:18,348 INFO mapred.FileInputFormat: Total input files to process : 1
2023-03-07 17:58:18,521 INFO mapreduce.JobSubmitter: number of splits:2
2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1678175622254_0018
2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Executing with tokens: []
2023-03-07 17:58:19,834 INFO conf.Configuration: resource-types.xml not found
2023-03-07 17:58:19,834 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2023-03-07 17:58:20,067 INFO impl.YarnClientImpl: Submitted application application_1678175622254_0018
2023-03-07 17:58:20,188 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1678175622254_0018/
2023-03-07 17:58:20,189 INFO mapreduce.Job: Running job: job_1678175622254_0018
2023-03-07 17:58:31,688 INFO mapreduce.Job: Job job_1678175622254_0018 running in uber mode : false
2023-03-07 17:58:31,703 INFO mapreduce.Job:  map 0% reduce 0%
2023-03-07 17:58:48,161 INFO mapreduce.Job:  map 100% reduce 0%
2023-03-07 17:58:57,234 INFO mapreduce.Job:  map 100% reduce 100%
2023-03-07 17:58:57,246 INFO mapreduce.Job: Job job_1678175622254_0018 completed successfully
2023-03-07 17:58:57,422 INFO mapreduce.Job: Counters: 54
	File System Counters
		FILE: Number of bytes read=6
		FILE: Number of bytes written=846725
		FILE: Number of read operations=0
		FILE: Number of large read operations=0
		FILE: Number of write operations=0
		HDFS: Number of bytes read=155239
		HDFS: Number of bytes written=122
		HDFS: Number of read operations=11
		HDFS: Number of large read operations=0
		HDFS: Number of write operations=2
		HDFS: Number of bytes read erasure-coded=0
	Job Counters 
		Launched map tasks=2
		Launched reduce tasks=1
		Data-local map tasks=2
		Total time spent by all maps in occupied slots (ms)=27059
		Total time spent by all reduces in occupied slots (ms)=6595
		Total time spent by all map tasks (ms)=27059
		Total time spent by all reduce tasks (ms)=6595
		Total vcore-milliseconds taken by all map tasks=27059
		Total vcore-milliseconds taken by all reduce tasks=6595
		Total megabyte-milliseconds taken by all map tasks=27708416
		Total megabyte-milliseconds taken by all reduce tasks=6753280
	Map-Reduce Framework
		Map input records=5601
		Map output records=0
		Map output bytes=0
		Map output materialized bytes=12
		Input split bytes=194
		Combine input records=0
		Combine output records=0
		Reduce input groups=0
		Reduce shuffle bytes=12
		Reduce input records=0
		Reduce output records=0
		Spilled Records=0
		Shuffled Maps =2
		Failed Shuffles=0
		Merged Map outputs=2
		GC time elapsed (ms)=406
		CPU time spent (ms)=2300
		Physical memory (bytes) snapshot=540459008
		Virtual memory (bytes) snapshot=6909349888
		Total committed heap usage (bytes)=301146112
		Peak Map Physical memory (bytes)=213553152
		Peak Map Virtual memory (bytes)=2301014016
		Peak Reduce Physical memory (bytes)=113618944
		Peak Reduce Virtual memory (bytes)=2307321856
	Shuffle Errors
		BAD_ID=0
		CONNECTION=0
		IO_ERROR=0
		WRONG_LENGTH=0
		WRONG_MAP=0
		WRONG_REDUCE=0
	File Input Format Counters 
		Bytes Read=155045
	File Output Format Counters 
		Bytes Written=122
2023-03-07 17:58:57,422 INFO streaming.StreamJob: Output directory: /appoLuca/out
[1] "printing output...\n"
data frame with 0 columns and 0 rows