Untitled
unknown
plain_text
2 years ago
4.0 kB
7
Indexable
> source('~/Luca/job1.R') Deleted /appoLuca/out packageJobJar: [/tmp/hadoop-unjar5561489735664231513/] [] /tmp/streamjob8211371644944017615.jar tmpDir=null 2023-03-07 17:58:15,917 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032 2023-03-07 17:58:16,536 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at master/192.168.1.183:8032 2023-03-07 17:58:17,163 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1678175622254_0018 2023-03-07 17:58:18,348 INFO mapred.FileInputFormat: Total input files to process : 1 2023-03-07 17:58:18,521 INFO mapreduce.JobSubmitter: number of splits:2 2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1678175622254_0018 2023-03-07 17:58:19,268 INFO mapreduce.JobSubmitter: Executing with tokens: [] 2023-03-07 17:58:19,834 INFO conf.Configuration: resource-types.xml not found 2023-03-07 17:58:19,834 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 2023-03-07 17:58:20,067 INFO impl.YarnClientImpl: Submitted application application_1678175622254_0018 2023-03-07 17:58:20,188 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1678175622254_0018/ 2023-03-07 17:58:20,189 INFO mapreduce.Job: Running job: job_1678175622254_0018 2023-03-07 17:58:31,688 INFO mapreduce.Job: Job job_1678175622254_0018 running in uber mode : false 2023-03-07 17:58:31,703 INFO mapreduce.Job: map 0% reduce 0% 2023-03-07 17:58:48,161 INFO mapreduce.Job: map 100% reduce 0% 2023-03-07 17:58:57,234 INFO mapreduce.Job: map 100% reduce 100% 2023-03-07 17:58:57,246 INFO mapreduce.Job: Job job_1678175622254_0018 completed successfully 2023-03-07 17:58:57,422 INFO mapreduce.Job: Counters: 54 File System Counters FILE: Number of bytes read=6 FILE: Number of bytes written=846725 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=155239 HDFS: Number of bytes written=122 HDFS: Number of read operations=11 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 HDFS: Number of bytes read erasure-coded=0 Job Counters Launched map tasks=2 Launched reduce tasks=1 Data-local map tasks=2 Total time spent by all maps in occupied slots (ms)=27059 Total time spent by all reduces in occupied slots (ms)=6595 Total time spent by all map tasks (ms)=27059 Total time spent by all reduce tasks (ms)=6595 Total vcore-milliseconds taken by all map tasks=27059 Total vcore-milliseconds taken by all reduce tasks=6595 Total megabyte-milliseconds taken by all map tasks=27708416 Total megabyte-milliseconds taken by all reduce tasks=6753280 Map-Reduce Framework Map input records=5601 Map output records=0 Map output bytes=0 Map output materialized bytes=12 Input split bytes=194 Combine input records=0 Combine output records=0 Reduce input groups=0 Reduce shuffle bytes=12 Reduce input records=0 Reduce output records=0 Spilled Records=0 Shuffled Maps =2 Failed Shuffles=0 Merged Map outputs=2 GC time elapsed (ms)=406 CPU time spent (ms)=2300 Physical memory (bytes) snapshot=540459008 Virtual memory (bytes) snapshot=6909349888 Total committed heap usage (bytes)=301146112 Peak Map Physical memory (bytes)=213553152 Peak Map Virtual memory (bytes)=2301014016 Peak Reduce Physical memory (bytes)=113618944 Peak Reduce Virtual memory (bytes)=2307321856 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=155045 File Output Format Counters Bytes Written=122 2023-03-07 17:58:57,422 INFO streaming.StreamJob: Output directory: /appoLuca/out [1] "printing output...\n" data frame with 0 columns and 0 rows
Editor is loading...