Untitled
unknown
plain_text
2 years ago
4.0 kB
7
Indexable
> source('~/Luca/job1.R')
Deleted /appoLuca/out
packageJobJar: [/tmp/hadoop-unjar5561489735664231513/] [] /tmp/streamjob8211371644944017615.jar tmpDir=null
2023-03-07 17:58:15,917 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032
2023-03-07 17:58:16,536 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032
2023-03-07 17:58:17,163 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1678175622254_0018
2023-03-07 17:58:18,348 INFO mapred.FileInputFormat: Total input files to process : 1
2023-03-07 17:58:18,521 INFO mapreduce.JobSubmitter: number of splits:2
2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1678175622254_0018
2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Executing with tokens: []
2023-03-07 17:58:19,834 INFO conf.Configuration: resource-types.xml not found
2023-03-07 17:58:19,834 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2023-03-07 17:58:20,067 INFO impl.YarnClientImpl: Submitted application application_1678175622254_0018
2023-03-07 17:58:20,188 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1678175622254_0018/
2023-03-07 17:58:20,189 INFO mapreduce.Job: Running job: job_1678175622254_0018
2023-03-07 17:58:31,688 INFO mapreduce.Job: Job job_1678175622254_0018 running in uber mode : false
2023-03-07 17:58:31,703 INFO mapreduce.Job: map 0% reduce 0%
2023-03-07 17:58:48,161 INFO mapreduce.Job: map 100% reduce 0%
2023-03-07 17:58:57,234 INFO mapreduce.Job: map 100% reduce 100%
2023-03-07 17:58:57,246 INFO mapreduce.Job: Job job_1678175622254_0018 completed successfully
2023-03-07 17:58:57,422 INFO mapreduce.Job: Counters: 54
File System Counters
FILE: Number of bytes read=6
FILE: Number of bytes written=846725
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=155239
HDFS: Number of bytes written=122
HDFS: Number of read operations=11
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
HDFS: Number of bytes read erasure-coded=0
Job Counters
Launched map tasks=2
Launched reduce tasks=1
Data-local map tasks=2
Total time spent by all maps in occupied slots (ms)=27059
Total time spent by all reduces in occupied slots (ms)=6595
Total time spent by all map tasks (ms)=27059
Total time spent by all reduce tasks (ms)=6595
Total vcore-milliseconds taken by all map tasks=27059
Total vcore-milliseconds taken by all reduce tasks=6595
Total megabyte-milliseconds taken by all map tasks=27708416
Total megabyte-milliseconds taken by all reduce tasks=6753280
Map-Reduce Framework
Map input records=5601
Map output records=0
Map output bytes=0
Map output materialized bytes=12
Input split bytes=194
Combine input records=0
Combine output records=0
Reduce input groups=0
Reduce shuffle bytes=12
Reduce input records=0
Reduce output records=0
Spilled Records=0
Shuffled Maps =2
Failed Shuffles=0
Merged Map outputs=2
GC time elapsed (ms)=406
CPU time spent (ms)=2300
Physical memory (bytes) snapshot=540459008
Virtual memory (bytes) snapshot=6909349888
Total committed heap usage (bytes)=301146112
Peak Map Physical memory (bytes)=213553152
Peak Map Virtual memory (bytes)=2301014016
Peak Reduce Physical memory (bytes)=113618944
Peak Reduce Virtual memory (bytes)=2307321856
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=155045
File Output Format Counters
Bytes Written=122
2023-03-07 17:58:57,422 INFO streaming.StreamJob: Output directory: /appoLuca/out
[1] "printing output...\n"
data frame with 0 columns and 0 rowsEditor is loading...