dekhtyar@cslvm57:~/369/lab6$ hadoop jar lab6.jar StudentListFilter 17/02/15 08:44:33 INFO impl.TimelineClientImpl: Timeline service address: http://cslvm56.csc.calpoly.edu:8188/ws/v1/timeline/ 17/02/15 08:44:33 INFO client.RMProxy: Connecting to ResourceManager at cslvm55.csc.calpoly.edu/129.65.156.55:8050 17/02/15 08:44:34 INFO client.AHSProxy: Connecting to Application History server at cslvm56.csc.calpoly.edu/129.65.156.56:10200 17/02/15 08:44:34 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 17/02/15 08:44:35 INFO input.FileInputFormat: Total input paths to process : 1 17/02/15 08:44:35 INFO mapreduce.JobSubmitter: number of splits:1 17/02/15 08:44:36 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1486956133951_0009 17/02/15 08:44:36 INFO impl.YarnClientImpl: Submitted application application_1486956133951_0009 17/02/15 08:44:36 INFO mapreduce.Job: The url to track the job: http://cslvm55.csc.calpoly.edu:8088/proxy/application_1486956133951_0009/ 17/02/15 08:44:36 INFO mapreduce.Job: Running job: job_1486956133951_0009 17/02/15 08:44:49 INFO mapreduce.Job: Job job_1486956133951_0009 running in uber mode : false 17/02/15 08:44:49 INFO mapreduce.Job: map 0% reduce 0% 17/02/15 08:44:58 INFO mapreduce.Job: Task Id : attempt_1486956133951_0009_m_000000_0, Status : FAILED Container [pid=25168,containerID=container_1486956133951_0009_01_000002] is running beyond physical memory limits. Current usage: 185.9 MB of 170 MB physical memory used; 1.7 GB of 357.0 MB virtual memory used. Killing container. Dump of the process-tree for container_1486956133951_0009_01_000002 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 25168 25166 25168 25168 (bash) 0 0 12894208 706 /bin/bash -c /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx136m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/dekhtyar/appcache/application_1486956133951_0009/container_1486956133951_0009_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 129.65.156.57 39450 attempt_1486956133951_0009_m_000000_0 2 1>/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000002/stdout 2>/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000002/stderr |- 25179 25168 25168 25168 (java) 495 48 1804386304 46893 /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx136m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/dekhtyar/appcache/application_1486956133951_0009/container_1486956133951_0009_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 129.65.156.57 39450 attempt_1486956133951_0009_m_000000_0 2 Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 17/02/15 08:45:11 INFO mapreduce.Job: Task Id : attempt_1486956133951_0009_m_000000_1, Status : FAILED Container [pid=25237,containerID=container_1486956133951_0009_01_000003] is running beyond physical memory limits. Current usage: 196.5 MB of 170 MB physical memory used; 1.7 GB of 357.0 MB virtual memory used. Killing container. Dump of the process-tree for container_1486956133951_0009_01_000003 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 25237 25235 25237 25237 (bash) 0 0 12894208 707 /bin/bash -c /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx136m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/dekhtyar/appcache/application_1486956133951_0009/container_1486956133951_0009_01_000003/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000003 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 129.65.156.57 39450 attempt_1486956133951_0009_m_000000_1 3 1>/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000003/stdout 2>/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000003/stderr |- 25247 25237 25237 25237 (java) 526 34 1804386304 49598 /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx136m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/dekhtyar/appcache/application_1486956133951_0009/container_1486956133951_0009_01_000003/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1486956133951_0009/container_1486956133951_0009_01_000003 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 129.65.156.57 39450 attempt_1486956133951_0009_m_000000_1 3 Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 17/02/15 08:45:20 INFO mapreduce.Job: map 100% reduce 0% 17/02/15 08:45:30 INFO mapreduce.Job: map 100% reduce 100% 17/02/15 08:45:30 INFO mapreduce.Job: Job job_1486956133951_0009 completed successfully 17/02/15 08:45:30 INFO mapreduce.Job: Counters: 51 File System Counters FILE: Number of bytes read=349 FILE: Number of bytes written=284947 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=3372 HDFS: Number of bytes written=311 HDFS: Number of read operations=6 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 Job Counters Failed map tasks=2 Launched map tasks=3 Launched reduce tasks=1 Other local map tasks=2 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=25431 Total time spent by all reduces in occupied slots (ms)=13914 Total time spent by all map tasks (ms)=25431 Total time spent by all reduce tasks (ms)=6957 Total vcore-milliseconds taken by all map tasks=25431 Total vcore-milliseconds taken by all reduce tasks=6957 Total megabyte-milliseconds taken by all map tasks=4323270 Total megabyte-milliseconds taken by all reduce tasks=2365380 Map-Reduce Framework Map input records=100 Map output records=16 Map output bytes=311 Map output materialized bytes=349 Input split bytes=118 Combine input records=0 Combine output records=0 Reduce input groups=16 Reduce shuffle bytes=349 Reduce input records=16 Reduce output records=16 Spilled Records=32 Shuffled Maps =1 Failed Shuffles=0 Merged Map outputs=1 GC time elapsed (ms)=346 CPU time spent (ms)=1800 Physical memory (bytes) snapshot=322375680 Virtual memory (bytes) snapshot=3811528704 Total committed heap usage (bytes)=163643392 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=3254 File Output Format Counters Bytes Written=311