summary,description,priority_name,issuetype_name,project_key,project_category_name,summary_char_count,summary_word_count,description_char_count,description_word_count,has_description,labels_count,has_assignee,votes_votes,watches_watch_count,created,resolutiondate Compilation error with guththila parser,Error while compiling with guththila parser from axis2 1.7.0 ( trunk ) ./configure --prefix=/usr/local/axis2c \ --disable-libxml2 \ --enable-guththila=yes \ --with-openssl=/usr/include/openssl \ --enable-tcp \ --enable-openssl \ --enable-tests=no WRAPPER_DIR is lost somewhere...,Trivial,Bug,AXIS2C,Axis,39,5,279,30,1,0,0,0.0,1.0,2016-07-16 17:03:05,2018-05-29 18:59:05 Fix KMSClientProvider for non-secure proxyuser use case,The issue was found after HADOOP-13988 by Hadoop-HDFS test (TestAclsEndToEnd). Sorry both Jenkins and I was not able to catch it. HADOOP-13988 fixed the issue for KMSClientProvider secure proxy user(token) use case. But the non-secure proxy user case should not be affected by the new logic. The ticket is open to fix it.,Major,Bug,HADOOP,Hadoop,55,7,321,53,1,0,1,0.0,3.0,2017-01-27 03:20:45,2017-01-27 05:43:50 Allow EngineConfigurationFactoryServlet to peek informations from servlet's init-param,"By default, EngineConfigurationFactoryServlet react to a ServletContext param. The ServletContext param contains only informations from the web-app level (we can use context-param elements). By the way, when we want to use multiples Axis Servlet in a simple WebApp, we cannot set a differente configuration for all of theses. A way to do this is to change the ServletContext param to a ServletConfig param. Because ServletConfig is at the servlet level and gice access to servlet's init-param(s) and to his facther ServletContext.",Unknown,Bug,AXIS,Axis,86,8,530,81,1,0,0,0.0,0.0,2003-11-26 00:35:02,2004-02-24 17:33:52 ItDataTypesTest and ItCreateTableDdlTest are flaky,"h3. Description & Root cause 1. ItDataTypesTest is flaky because previous ItCreateTableDdlTest tests failed to stop replicas on node stop: !Снимок экрана от 2023-04-06 10-39-32.png! {code:java} java.lang.AssertionError: There are replicas alive [replicas=[b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_21, b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_6, b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_13, b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_8, b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_9, b86c60a8-4ea3-4592-abef-6438cfc4cdb2_part_11]] at org.apache.ignite.internal.replicator.ReplicaManager.stop(ReplicaManager.java:341) at org.apache.ignite.internal.app.LifecycleManager.lambda$stopAllComponents$1(LifecycleManager.java:133) at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133) at org.apache.ignite.internal.app.LifecycleManager.stopAllComponents(LifecycleManager.java:131) at org.apache.ignite.internal.app.LifecycleManager.stopNode(LifecycleManager.java:115){code} 2. The reason why we failed to stop replicas is the race between tablesToStopInCaseOfError cleanup and adding tables to tablesByIdVv. On TableManager stop, we stop and cleanup all table resources like replicas and raft nodes {code:java} public void stop() { ... Map tables = tablesByIdVv.latest(); // 1* cleanUpTablesResources(tables); cleanUpTablesResources(tablesToStopInCaseOfError); ... }{code} where tablesToStopInCaseOfError is a sort of pending tables list which one is cleared on cfg storage revision update. tablesByIdVv *listens same storage revision update event* in order to publish tables related to the given revision or in other words make such tables accessible from tablesByIdVv.latest(); that one that is used in order to retrieve tables for cleanup on components stop (see // 1* above) {code:java} public TableManager( ... tablesByIdVv = new IncrementalVersionedValue<>(registry, HashMap::new); registry.accept(token -> { tablesToStopInCaseOfError.clear(); return completedFuture(null); }); {code} However inside IncrementalVersionedValue we have async storageRevision update processing {code:java} updaterFuture = updaterFuture.whenComplete((v, t) -> versionedValue.complete(causalityToken, localUpdaterFuture)); {code} As a result it's possible that we will clear tablesToStopInCaseOfError before publishing same revision tables to tablesByIdVv, so that we will miss that cleared tables in tablesByIdVv.latest() which is used in TableManager#stop. h3. Implementation Notes 1. First of all I've renamed tablesToStopInCaseOfError to pending tables, because they aren't only ...InCaseOfError. 2. I've also reworked tablesToStopInCaseOfError cleanup by substituting tablesToStopInCaseOfError.clear on revision change with {code:java} tablesByIdVv.get(causalityToken).thenAccept(ignored -> inBusyLock(busyLock, ()-> { pendingTables.remove(tblId); })); {code} meaning that we 2.1. remove specific table by id instead of whole map clear. 2.2. do that removal on corresponding table publishing wihtin tablesByIdVv. 3. That means that at some point right after the publishing but before removal it's possible to have same table both within tablesByIdVv and pendingTables thus in order not to stop same table twice (which is safe by the way because of idempotentce) I've substituted {code:java} cleanUpTablesResources(tables); cleanUpTablesResources(tablesToStopInCaseOfError); {code} with {code:java} Map tablesToStop = Stream.concat(tablesByIdVv.latest().entrySet().stream(), pendingTables.entrySet().stream()). collect(Collectors.toMap(Map.Entry::getKey, Map.Entry::getValue, (v1, v2) -> v1)); cleanUpTablesResources(tablesToStop); {code}",Major,Bug,IGNITE,Ignite,50,5,3664,359,1,1,1,0.0,2.0,2023-04-05 22:18:45,2023-04-07 11:46:28 StreamIoHandler can flush garbled data.,"The OutputStream which StreamIoHandler provided doesn't perform defensive copy. Some wrapper OutputStreams and Writers (e.g. BufferedOutputStream and BufferedWriter) reuse their internal byte array, and causes the byte buffer to be modified before it's actually written out to the channel. There are two solutions: 1) Perform defensive copy in write(byte[], int, int): public void write( byte[] b, int off, int len ) throws IOException { write( ByteBuffer.wrap( (byte[]) b.clone(), off, len ) ); } 2) Wait for the WriteFuture for every operation. The former sounds better IMO.",Major,Bug,DIRMINA,MINA,39,5,576,86,1,0,1,0.0,0.0,2007-04-13 14:22:28,2007-04-13 14:34:24 [Automation] Failed to create volume from snapshot in KVM,"Steps to reproduce Step 1 : Create snapshot of ROOT volume Step 2 : Create volume from snapshot Failed to create volume with below null pointer exception 2013-11-01 08:19:18,229 DEBUG [agent.transport.Request] (Job-Executor-147:job-6486 = [ 14b465b9-0c03-4783-866f-1296b20c358b ]) Seq 1-894971116: Sending { Cmd , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 100001, [{""com.cloud.agent.api.routing.IpAssocCommand"":{""ipAddresses"":[{""accountId"":911,""publicIp"":""10.223.122.92"",""sourceNat"":true,""add"":true,""oneToOneNat"":false,""firstIP"":true,""vlanId"":""1221"",""vlanGateway"":""10.223.122.65"",""vlanNetmask"":""255.255.255.192"",""vifMacAddress"":""06:39:a6:00:00:55"",""networkRate"":200,""trafficType"":""Public""},{""accountId"":911,""publicIp"":""10.223.122.113"",""sourceNat"":false,""add"":true,""oneToOneNat"":false,""firstIP"":false,""vlanId"":""1221"",""vlanGateway"":""10.223.122.65"",""vlanNetmask"":""255.255.255.192"",""vifMacAddress"":""06:52:bb:00:00:55"",""networkRate"":200,""trafficType"":""Public""},{""accountId"":911,""publicIp"":""10.223.122.79"",""sourceNat"":false,""add"":true,""oneToOneNat"":false,""firstIP"":false,""vlanId"":""1221"",""vlanGateway"":""10.223.122.65"",""vlanNetmask"":""255.255.255.192"",""vifMacAddress"":""06:52:bb:00:00:55"",""networkRate"":200,""trafficType"":""Public""}],""accessDetails"":{""router.guest.ip"":""10.1.1.1"",""zone.network.type"":""Advanced"",""router.ip"":""169.254.0.81"",""router.name"":""r-1662-QA""},""wait"":0}}] } 2013-11-01 08:19:18,345 DEBUG [agent.transport.Request] (AgentManager-Handler-6:null) Seq 2-877402380: Processing: { Ans: , MgmtId: 29066118877352, via: 2, Ver: v1, Flags: 110, [{""com.cloud.agent.api.Answer"":{""result"":false,""details"":""java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1178)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:86)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1286)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n"",""wait"":0}}] } 2013-11-01 08:19:18,345 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-6:null) Seq 2-877402380: No more commands found 2013-11-01 08:19:18,345 DEBUG [agent.transport.Request] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Seq 2-877402380: Received: { Ans: , MgmtId: 29066118877352, via: 2, Ver: v1, Flags: 110, { Answer } } 2013-11-01 08:19:18,350 WARN [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@3918ddd), no need to delete from object in store ref table 2013-11-01 08:19:18,372 WARN [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Snapshot 38 is not found on image store 1, so no need to delete 2013-11-01 08:19:18,372 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Failed to create volume from snapshot:java.lang.NullPointerException at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1178) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:86) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1286) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-11-01 08:19:18,372 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Failed to create volume: 1784 com.cloud.utils.exception.CloudRuntimeException: Failed to create volume from snapshot:java.lang.NullPointerException at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1178) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:86) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1286) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:559) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:604) at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:1057) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:183) at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:189) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-11-01 08:19:18,398 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-120:job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ]) Complete async job-6487 = [ f6fbb88e-1fe1-4507-9406-b8e62d9e1f70 ], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create a volume 2013-11-01 08:19:18,492 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-894971115: Received: { Ans: , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }",Blocker,Bug,CLOUDSTACK,Cloudstack,57,9,7363,328,1,0,1,0.0,2.0,2013-11-01 16:23:29,2013-11-01 21:43:59 Derive whitelist tags from CSP,"When dynamically creating an {{iframe}}, the {{iframe}}'s {{src}} is never loaded. This worked without issues using 3.9.2. Example Code: {code:javascript} i = document.createElement(""iframe""); i.src = ""https://example.org""; document.body.appendChild(i); {code} Please note, that you have to extend the {{Content-Security-Policy}} headers to include {{https:}} to pass CSP restrictions. I have also created a sample project to reproduce the problem. You may find it at https://github.com/schmidt/cordova-ios-iframe-example",Minor,Improvement,CB,Cordova,30,5,521,62,1,0,0,0.0,3.0,2016-01-12 13:20:36,2019-11-29 13:46:24 (V2) Accept $format=atom for function imports which return entities,(V2) Accept $format=atom for function imports which return entities.,Minor,Bug,OLINGO,Olingo,67,9,68,9,1,0,1,0.0,0.0,2015-04-27 15:41:28,2015-04-29 15:28:07 Add spark3 to nexmark runs,,P2,Sub-task,BEAM,Beam,26,5,0,0,0,0,1,0.0,1.0,2021-09-17 09:56:40,2021-09-30 17:24:34 S3A directory committer commit job fails if _temporary directory created under dest,"The directory staging committer fails in commit job if any temporary files/dirs have been created. Spark work can create such a dir for placement of absolute files. This is because commitJob() looks for the dest dir existing, not containing non-hidden files. As the comment says, ""its kind of superfluous"". More specifically, it means jobs which would commit with the classic committer & overwrite=false will fail Proposed fix: remove the check",Major,Sub-task,HADOOP,Hadoop,83,12,444,70,1,0,1,0.0,3.0,2018-05-15 16:44:13,2018-05-17 20:09:42 Tree: Open/close nodes with keyboard not working.,"This bug was imported from another system and requires review from a project committer before some of the details can be marked public. For more information about historical bugs, please read: [Why are some bugs missing information?|https://bugs.adobe.com/confluence/display/ADOBE/Why+are+some+bugs+missing+information] You can request a review of this bug report by sending an e-mail to: [Request Public Review for This Bug|mailto:jira_support@adobe.com?subject=Bug%20Review%20Request%20-%20FLEXENT-83&body=Please%20review%20this%20historical%20bug%20report%20and%20consider%20making%20additional%20information%20public.%20%20I%20understand%20that%20my%20request%20(including%20this%20e-mail)%20may%20be%20included%20as%20part%20of%20the%20public%20history%20in%20the%20bug%20comments.%0D%0A%0D%0AAdditional Information: ] Please be sure to include the bug number in your request.",Major,Bug,FLEX,Flex,49,7,885,70,1,0,1,0.0,0.0,2006-02-28 00:22:17,2006-03-22 01:42:18 Specified cube when querying by API,"Support specified cube when using query API. UseCase1: For CubeA has dim a,b,c,d ,segments 12.01-now,CubeB has dim b,c,e,segments 12.08-now, with same hive table and same measure. While querying ""select b,c,count(*) from db.table group by b,c; "" , will hit CubeB, so that result of 12.01-12.08 will disappear. UseCase2: For testing,build many cubes with different config, will need to switch disable|enable all the time. See discussion here: http://mail-archives.apache.org/mod_mbox/kylin-user/202001.mbox/%3c976A402F-3D7E-4B99-B87E-D6B39FF2F80B@yidian-inc.com%3e",Major,Improvement,KYLIN,Kylin,35,6,563,67,1,0,1,0.0,5.0,2019-12-23 13:00:10,2020-02-03 10:43:10 Xcode 4.5 - JSONKit static analyzer issues,See: https://github.com/johnezang/JSONKit/issues/90 and https://github.com/johnezang/JSONKit/issues/98,Minor,Bug,CB,Cordova,42,7,102,4,1,0,1,0.0,1.0,2012-09-21 22:05:52,2013-01-09 01:50:30 Update the ServiceMix extensions build at the Codehaus to version 3.0-SNAPSHOT and to use the latest ActiveMQ and ServiceMix jars,# Update the ServiceMix extensions build version from 2.1-SNAPSHOT to 3.0-SNAPSHOT # Update the ServiceMix extensions to make use of the new groupId: org.apache.servicemix # Update the ServiceMix extensions to make use of org.apache.activemq.Service instead of org.apache.activemq.service.Service,Major,Bug,SM,ServiceMix,129,20,296,37,1,0,1,0.0,0.0,2006-06-15 00:47:52,2006-06-15 03:30:49 check that everything compile and run fine with Java 8,Java 8 will be released shortly: we need a good support as soon as possible Some ASF Jenkins jobs are available to check and see results in a shared place: - [maven-plugins-ITs-m3.1.x-with-maven-plugin-jdk-1.8|https://builds.apache.org/view/M-R/view/Maven/job/maven-plugins-ITs-m3.1.x-with-maven-plugin-jdk-1.8/modules] there is a [Wiki page too with some problems tracked|https://cwiki.apache.org/confluence/display/MAVEN/Java+8+Upgrade],Major,Task,MNG,Maven,54,10,438,42,1,0,0,3.0,8.0,2013-12-15 01:10:32,2018-12-01 17:20:00 Add Python option to bootstrap,Currently the only way to build minifi with Python support is to enter the corresponding CMAKE command manually. Bootstrap script should provide an option to do so.,Minor,Improvement,MINIFICPP,NiFi,30,5,164,27,1,0,1,0.0,1.0,2019-02-11 14:44:19,2019-04-11 18:40:22 Resolve Oracle JET support,"Oracle JET apps are created on the command line via ojet-cli command line interface. The only feature that is relevant to NetBeans is to have editor support for code completion, templates, etc, all other features need to be removed, e.g., in the Project Properties dialog.",Major,Sub-task,NETBEANS,NetBeans,26,4,272,45,1,0,0,0.0,2.0,2019-06-18 11:20:57,2020-09-13 19:43:12 "regression failing, assert in UnixNetVConnection",configure --enable-debug traffic_server -R1 .... FATAL: UnixNetVConnection.cc:671: failed assert `!closed` proxy/traffic_server - STACK TRACE: proxy/traffic_server(ink_fatal_va+0xad)[0x72db64] proxy/traffic_server(ink_fatal+0xe1)[0x72dd35] proxy/traffic_server(_ink_assert+0xb4)[0x72c4c4] proxy/traffic_server(_ZN18UnixNetVConnection10do_io_readEP12ContinuationiP9MIOBuffer+0x39)[0x6fdabd] proxy/traffic_server(_ZN11VConnection5do_ioEiP12ContinuationiP9MIOBufferi+0x54)[0x4d6d64] proxy/traffic_server(INKVConnRead+0x160)[0x4e3c88] proxy/traffic_server[0x4f7b89] proxy/traffic_server(_ZN15INKContInternal12handle_eventEiPv+0xa0)[0x4e0f90] proxy/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d58a7] proxy/traffic_server(_ZN18UnixNetVConnection11acceptEventEiP5Event+0x5a7)[0x7024f1] proxy/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d58a7] proxy/traffic_server(_Z10net_acceptP9NetAcceptPvb+0x385)[0x6f6e74] proxy/traffic_server(_ZN9NetAccept11acceptEventEiPv+0x248)[0x6f6076] proxy/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d58a7] proxy/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x12b)[0x719d83] proxy/traffic_server(_ZN7EThread7executeEv+0x207)[0x71a105] proxy/traffic_server[0x719642] /lib64/libpthread.so.0[0x3bc2206407] /lib64/libc.so.6(clone+0x6d)[0x3bc16d4b0d] The problem is caused by the iocore/net code leaving the UnixNetVConnection in a bad state (closed) when releasing it to the free list.,Major,Bug,TS,Traffic Server,48,5,1454,56,1,0,0,0.0,0.0,2009-12-07 02:02:13,2009-12-08 16:33:50 "HelpFormatter.printHelp(String cmdLineSyntax, String header, Options options, String footer) throws exception if footer contains CR LF","If String footer contains windows new line, printHelp throws exception. If it contains only LF line endings, it works fine on Linux and Windows platforms.",Major,Bug,CLI,Commons,134,15,154,25,1,0,0,0.0,0.0,2005-12-20 21:55:21,2008-09-16 00:38:20 "Disable text extraction whne using type3 fonts (was: Text extracted from a TeX-created PDF file is unintelligible, but not of the form a1a2a3...)","Text extracted from some PDF files is completely unintelligible, presumably depending on the software used to create the file. In this example, a combination of dvips(k) 5.95a Copyright 2005 Radical Eye Software (to create PostScript) and Acrobat Distiller 8.1.0 (Windows) (to create the PDF file) was used. The text extracted looks like CFCTCXCTD6D7D8D6CPH3B9C1D2D7D8CXD8D9D8 CUH0D6 BTD2CVCTDBCPD2CSD8CT BTD2CPD0DDD7CXD7 D9D2CS CBD8D3CRCWCPD7D8CXCZ CXD1 BYD3D6D7CRCWD9D2CVD7DACTD6CQD9D2CS BUCTD6D0CXD2 CTBACEBA C Only rarely some bits and pieces of recognisable formulas are interspersed. The text copied using either Acrobat Reader or Preview looks different, but is similarly unintelligible.",Minor,Improvement,PDFBOX,PDFBox,145,23,694,89,1,0,0,0.0,1.0,2010-05-16 14:27:34,2014-10-11 03:20:42 "train_ffm(features,label) causes NPE while train_ffm(features,label,'') works fine","train_ffm(features,label) causes NPE while train_ffm(features,label,'') works fine. {code:java} Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Exception caused in the 1-th call of train() at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:404) at hivemall.fm.FactorizationMachineUDTF.process(FactorizationMachineUDTF.java:314) at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.java:107) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45) at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:262) ... 11 more Caused by: java.lang.NullPointerException at hivemall.fm.FactorizationMachineModel.initV(FactorizationMachineModel.java:391) at hivemall.fm.FFMStringFeatureMapModel.getV(FFMStringFeatureMapModel.java:152) at hivemall.fm.FieldAwareFactorizationMachineModel.predict(FieldAwareFactorizationMachineModel.java:98) at hivemall.fm.FieldAwareFactorizationMachineUDTF.trainTheta(FieldAwareFactorizationMachineUDTF.java:195) at hivemall.fm.FactorizationMachineUDTF.train(FactorizationMachineUDTF.java:401) ... 18 more {code}",Critical,Bug,HIVEMALL,Retired,82,7,1358,55,1,0,1,0.0,2.0,2019-09-12 09:59:30,2019-10-03 10:34:35 We should have a config to indicate the Timeline Service version,"So far RM, MR AM, DA AM added/changed new config to enable the feature to write the timeline data to v2 server. It's good to have a YARN timeline-service.version config like timeline-service.enable to indicate the version of the running timeline service with the given YARN cluster. It's beneficial for users to more smoothly move from v1 to v2, as they don't need to change the existing config, but switch this config from v1 to v2. And each framework doesn't need to have their own v1/v2 config.",Major,New Feature,YARN,Hadoop,64,11,497,86,1,0,1,0.0,10.0,2015-05-11 23:55:48,2015-12-10 12:00:02 Jackrabbit thread contention issue due to fat lock,"Hello, We are running jackrabbit 1.4.5 using a persistent file data store within a weblogic container and encountering a variety of thread locking issues. To get around the problem, we are forced synchronize thread access to the JCR repository or reduce thread worker count to 1 which has a heavy performance impact on our application. I'm not exactly sure what the problem is and was wondering someone is looking into this issue and if there is a workaround/fix planned? <[STUCK] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for ""1,863"" seconds working on the request ""weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@2117cc9"", which is more than the configured time (StuckThreadMaxTime) of ""1,800"" seconds. Stack trace: Thread-94 ""[STUCK] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'"" { -- Waiting for notification on: EDU.oswego.cs.dl.util.concurrent.WriterPreferenceReadWriteLock$WriterLock@152c384[fat lock] java.lang.Object.wait(Object.java:???) java.lang.Object.wait(Object.java:474) EDU.oswego.cs.dl.util.concurrent.WriterPreferenceReadWriteLock$WriterLock.acquire(Unknown Source) org.apache.jackrabbit.core.journal.AbstractJournal.lockAndSync(AbstractJournal.java:235) org.apache.jackrabbit.core.journal.DefaultRecordProducer.append(DefaultRecordProducer.java:49) } > <[STUCK] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for ""1,916"" seconds working on the request ""weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@227b6d4"", which is more than the configured time (StuckThreadMaxTime) of ""1,800"" seconds. Stack trace: Thread-25 ""[STUCK] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'"" { -- Waiting for notification on: EDU.oswego.cs.dl.util.concurrent.LinkedNode@42d58e0[fat lock] java.lang.Object.wait(Object.java:???) java.lang.Object.wait(Object.java:474) EDU.oswego.cs.dl.util.concurrent.SynchronousChannel.put(Unknown Source) EDU.oswego.cs.dl.util.concurrent.PooledExecutor$WaitWhenBlocked.blockedAction(Unknown Source) EDU.oswego.cs.dl.util.concurrent.PooledExecutor.execute(Unknown Source) ... org.apache.jackrabbit.core.state.XAItemStateManager.update(XAItemStateManager.java:334) org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:307) org.apache.jackrabbit.core.state.SessionItemStateManager.update(SessionItemStateManager.java:317) org.apache.jackrabbit.core.ItemImpl.save(ItemImpl.java:1072) ^-- Holding lock: org.apache.jackrabbit.core.query.lucene.VolatileIndex@3eb0f41[thin lock] org.apache.jackrabbit.core.SessionImpl.save(SessionImpl.java:895) org.apache.jackrabbit.jca.JCASessionHandle.save(JCASessionHandle.java:178) com.qpass.inventory.ingestion.IngestionServiceImpl$1.doInJCR(IngestionServiceImpl.java:124) com.qpass.inventory.model.JCRTemplate.execute(JCRTemplate.java:17) com.qpass.inventory.ingestion.IngestionServiceImpl.ingestProduct(IngestionServiceImpl.java:93) com.qpass.inventory.ingestion.bulk.AbstractBulkIngester.ingestProduct(AbstractBulkIngester.java:42) com.qpass.inventory.ingestion.bulk.ZipFileBulkIngester.processFile(ZipFileBulkIngester.java:35) com.qpass.inventory.ingestion.bulk.IngestionWorker.processFile(IngestionWorker.java:26) com.qpass.inventory.ingestion.bulk.IngestionWorker$1.run(IngestionWorker.java:64) org.springframework.scheduling.commonj.DelegatingWork.run(DelegatingWork.java:61) weblogic.work.j2ee.J2EEWorkManager$WorkWithListener.run(J2EEWorkManager.java:245) weblogic.work.ExecuteThread.execute(ExecuteThread.java:206) weblogic.work.ExecuteThread.run(ExecuteThread.java:173) } > <[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for ""1,891"" seconds working on the request ""weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@2117c83"", which is more than the configured time (StuckThreadMaxTime) of ""1,800"" seconds. Stack trace: Thread-24 ""[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'"" { -- Waiting for notification on: EDU.oswego.cs.dl.util.concurrent.WriterPreferenceReadWriteLock$WriterLock@152c384[fat lock] java.lang.Object.wait(Object.java:???) java.lang.Object.wait(Object.java:474) EDU.oswego.cs.dl.util.concurrent.WriterPreferenceReadWriteLock$WriterLock.acquire(Unknown Source) org.apache.jackrabbit.core.journal.AbstractJournal.lockAndSync(AbstractJournal.java:235) org.apache.jackrabbit.core.journal.DefaultRecordProducer.append(DefaultRecordProducer.java:49) org.apache.jackrabbit.core.cluster.ClusterNode$WorkspaceUpdateChannel.updateCreated(ClusterNode.java:556) ... <[STUCK] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for ""1,803"" seconds working on the request ""Http Request: /inventory/rpc/searchService"", which is more than the configured time (StuckThreadMaxTime) of ""1,800"" seconds. Stack trace: Thread-51 ""[STUCK] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'"" { -- Waiting for notification on: java.lang.Object@1569e04[fat lock] java.lang.Object.wait(Object.java:???) java.lang.Object.wait(Object.java:474) org.apache.jackrabbit.core.query.lucene.MultiIndex.getIndexReader(MultiIndex.java:694) org.apache.jackrabbit.core.query.lucene.SearchIndex.getIndexReader(SearchIndex.java:825) org.apache.jackrabbit.core.query.lucene.SearchIndex.executeQuery(SearchIndex.java:682) org.apache.jackrabbit.core.query.lucene.QueryResultImpl.executeQuery(QueryResultImpl.java:242) org.apache.jackrabbit.core.query.lucene.QueryResultImpl.getResults(QueryResultImpl.java:271) org.apache.jackrabbit.core.query.lucene.QueryResultImpl.(QueryResultImpl.java:177) org.apache.jackrabbit.core.query.lucene.QueryImpl.execute(QueryImpl.java:105) org.apache.jackrabbit.core.query.QueryImpl.execute(QueryImpl.java:174) com.qpass.inventory.service.QueryProfiler.execute(QueryProfiler.java:20) com.qpass.inventory.service.SearchServiceImpl$1.doInJCR(SearchServiceImpl.java:59) com.qpass.inventory.model.JCRTemplate.execute(JCRTemplate.java:17) com.qpass.inventory.service.SearchServiceImpl.doSearch(SearchServiceImpl.java:54) com.qpass.inventory.ui.impl.SearchUIServiceImpl.search(SearchUIServiceImpl.java:48) sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:???) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:570) org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309) org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148) org.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:62) org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148) org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:151) $Proxy74.search(Unknown Source) sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:???) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:570) org.gwtwidgets.server.spring.GWTRPCServiceExporter.invokeMethodOnService(GWTRPCServiceExporter.java:157) org.gwtwidgets.server.spring.GWTRPCServiceExporter.processCall(GWTRPCServiceExporter.java:295) com.google.gwt.user.server.rpc.RemoteServiceServlet.doPost(RemoteServiceServlet.java:173) org.gwtwidgets.server.spring.GWTRPCServiceExporter.handleRequest(GWTRPCServiceExporter.java:361) com.qpass.base.ui.security.GWTServiceExporter.handleRequest(GWTServiceExporter.java:45) org.springframework.web.servlet.mvc.HttpRequestHandlerAdapter.handle(HttpRequestHandlerAdapter.java:49) org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:831) org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:781) org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:567) org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:511) javax.servlet.http.HttpServlet.service(HttpServlet.java:736) javax.servlet.http.HttpServlet.service(HttpServlet.java:851) weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224) weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108) weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:198) weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26) weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41) org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:259) org.acegisecurity.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:93) org.acegisecurity.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:71) org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:259) com.qpass.usersecurity.auth.UpdatePermissionsOnContextChangeFilter.doFilter(UpdatePermissionsOnContextChangeFilter.java:44) org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:259) org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:191) org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:259) org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:195) org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:259) org.acegisecurity.util.FilterChainProxy.doFilter(FilterChainProxy.java:122) org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236) org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:154) weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41) com.qpass.base.applicationcontext.RequestContextFilter.doFilter(RequestContextFilter.java:103) org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236) org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:154) weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41) org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:90) org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:61) weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41) weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:24) weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41) weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3214) weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308) weblogic.security.service.SecurityManager.runAs(SecurityManager.java:117) weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:1946) weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1868) weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1331) weblogic.work.ExecuteThread.execute(ExecuteThread.java:206) weblogic.work.ExecuteThread.run(ExecuteThread.java:173) } <[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for ""696"" seconds working on the request ""weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@863e564"", which is more than the configured time (StuckThreadMaxTime) of ""600"" seconds. Stack trace: Thread-21 ""[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'"" { java.io.FileOutputStream.writeBytes(FileOutputStream.java:???) java.io.FileOutputStream.write(FileOutputStream.java:260) java.io.BufferedOutputStream.write(BufferedOutputStream.java:100) ^-- Holding lock: java.io.BufferedOutputStream@39d70a5[thin lock] org.apache.jackrabbit.core.persistence.util.FileSystemBLOBStore.put(FileSystemBLOBStore.java:88) org.apache.jackrabbit.core.persistence.bundle.util.BundleBinding.writeState(BundleBinding.java:561) org.apache.jackrabbit.core.persistence.bundle.util.BundleBinding.writeBundle(BundleBinding.java:245) org.apache.jackrabbit.core.persistence.bundle.Oracle9PersistenceManager.storeBundle(Oracle9PersistenceManager.java:114) ^-- Holding lock: org.apache.jackrabbit.core.persistence.bundle.Oracle9PersistenceManager@140f7b9[thin lock] org.apache.jackrabbit.core.persistence.bundle.AbstractBundlePersistenceManager.putBundle(AbstractBundlePersistenceManager.java:703) org.apache.jackrabbit.core.persistence.bundle.AbstractBundlePersistenceManager.store(AbstractBundlePersistenceManager.java:526) ^-- Holding lock: org.apache.jackrabbit.core.persistence.bundle.Oracle9PersistenceManager@140f7b9[thin lock] org.apache.jackrabbit.core.persistence.bundle.BundleDbPersistenceManager.store(BundleDbPersistenceManager.java:517) ^-- Holding lock: org.apache.jackrabbit.core.persistence.bundle.Oracle9PersistenceManager@140f7b9[thin lock] org.apache.jackrabbit.core.state.SharedItemStateManager$Update.end(SharedItemStateManager.java:699) org.apache.jackrabbit.core.state.SharedItemStateManager.update(SharedItemStateManager.java:873) org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:334) org.apache.jackrabbit.core.state.XAItemStateManager.update(XAItemStateManager.java:334) org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:307) org.apache.jackrabbit.core.state.SessionItemStateManager.update(SessionItemStateManager.java:317) org.apache.jackrabbit.core.ItemImpl.save(ItemImpl.java:1072) ^-- Holding lock: org.apache.jackrabbit.core.XASessionImpl@1f2653b[thin lock] org.apache.jackrabbit.core.SessionImpl.save(SessionImpl.java:895) org.apache.jackrabbit.jca.JCASessionHandle.save(JCASessionHandle.java:178) com.qpass.inventory.ingestion.IngestionServiceImpl$1.doInJCR(IngestionServiceImpl.java:140) com.qpass.inventory.model.JCRTemplate.execute(JCRTemplate.java:17) com.qpass.inventory.ingestion.IngestionServiceImpl.ingestProduct(IngestionServiceImpl.java:112) ^-- Holding lock: java.lang.Object@849ca9e[fat lock] com.qpass.inventory.ingestion.bulk.AbstractBulkIngester.ingestProduct(AbstractBulkIngester.java:42) com.qpass.inventory.ingestion.bulk.ZipFileBulkIngester.processFile(ZipFileBulkIngester.java:35) com.qpass.inventory.ingestion.bulk.IngestionWorker.processFile(IngestionWorker.java:26) com.qpass.inventory.ingestion.bulk.IngestionWorker$1.run(IngestionWorker.java:64) org.springframework.scheduling.commonj.DelegatingWork.run(DelegatingWork.java:61) weblogic.work.j2ee.J2EEWorkManager$WorkWithListener.run(J2EEWorkManager.java:245) weblogic.work.ExecuteThread.execute(ExecuteThread.java:206) weblogic.work.ExecuteThread.run(ExecuteThread.java:173)",Major,Bug,JCR,Jackrabbit,50,8,16054,598,1,0,0,0.0,3.0,2008-11-02 22:25:29,2009-01-14 13:27:26 Change Java package name,Change package name to org.apache.commons.lang3,Major,Task,LANG,Commons,24,4,47,5,1,0,0,0.0,0.0,2009-12-10 12:32:09,2009-12-10 13:09:12 Add ingress port based sasl resolver,"This Jira extends the SASL properties resolver interface to take an ingress port parameter, and also adds an implementation based on this.",Major,Sub-task,HDFS,Hadoop,36,6,138,22,1,0,1,0.0,6.0,2018-05-11 22:08:44,2018-11-29 22:50:58 Fix the scripts for Linux,Fix the scripts for Linux.,Major,Bug,DIRKRB,Directory,25,5,26,5,1,0,1,0.0,1.0,2015-07-16 07:28:47,2015-07-16 08:21:13 Content package extractor fetch nodes only under base path,ContentPackageExtractor fetch all distributed paths from the repository to evaluate if they correspond to content packages. ContentPackageExtractor should only fetch nodes from the repository when the path is under the base content package path.,Minor,Improvement,SLING,Sling,58,9,245,34,1,0,1,0.0,1.0,2021-07-12 21:20:29,2021-07-13 09:23:25 Remove org.apache.directory.api:api-ldap-model from Ambari server's dependencies due to security concerns,"Remove {{org.apache.directory.api:api-ldap-model}} from Ambari server's dependencies due to security concerns regarding the following CVE: * CVE-2018-1337: Plaintext Password Disclosure in Secured Channel See https://cve.mitre.org/cgi-bin/cvename.cgi?name=2018-1337 Though Ambari server includes {{api-ldap-model-1.0.0.jar}} in {{/usr/lib/ambari-server}}, the library is not used. Therefore, the vulnerability is not exposed and the library may be excluded from Ambari's package.",Major,Bug,AMBARI,Ambari,105,10,479,51,1,1,1,0.0,2.0,2018-07-13 17:19:20,2018-07-19 11:11:13 ADM backslash issue,ADM backslash issue,Unknown,Bug,ASTERIXDB,AsterixDB,19,3,19,3,1,0,0,0.0,0.0,2014-04-04 23:00:35,2015-08-12 12:25:47 HBaseConnectorITCase NullPointerException,"{noformat} ------------------------------------------------------- T E S T S ------------------------------------------------------- Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 Running org.apache.flink.addons.hbase.HBaseConnectorITCase 14:32:21,877 INFO HBaseTestingClusterAutostarter: 151 - HBase minicluster: Starting 14:32:22,007 INFO HBaseCommonTestingUtility:1007 - Starting up minicluster with 1 master(s) and 1 regionserver(s) and 1 datanode(s) 14:32:22,013 INFO HBaseCommonTestingUtility: 487 - Created new mini-cluster data directory: /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8, deleteOnExit=true 14:32:22,013 INFO HBaseCommonTestingUtility: 737 - Setting test.cache.data to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/cache_data in system properties and HBase conf 14:32:22,014 INFO HBaseCommonTestingUtility: 737 - Setting hadoop.tmp.dir to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/hadoop_tmp in system properties and HBase conf 14:32:22,014 INFO HBaseCommonTestingUtility: 737 - Setting hadoop.log.dir to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/hadoop_logs in system properties and HBase conf 14:32:22,014 INFO HBaseCommonTestingUtility: 737 - Setting mapreduce.cluster.local.dir to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/mapred_local in system properties and HBase conf 14:32:22,015 INFO HBaseCommonTestingUtility: 737 - Setting mapreduce.cluster.temp.dir to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/mapred_temp in system properties and HBase conf 14:32:22,015 INFO HBaseCommonTestingUtility: 728 - read short circuit is OFF 14:32:22,077 WARN NativeCodeLoader: 62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Formatting using clusterid: testClusterID 14:32:22,361 INFO FSNamesystem: 677 - fsLock is fair:true 14:32:22,380 INFO HostFileManager: 304 - read includes: HostSet( ) 14:32:22,380 INFO HostFileManager: 311 - read excludes: HostSet( ) 14:32:22,381 INFO deprecation:1009 - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping 14:32:22,381 INFO DatanodeManager: 234 - dfs.block.invalidate.limit=1000 14:32:22,381 INFO DatanodeManager: 240 - dfs.namenode.datanode.registration.ip-hostname-check=true 14:32:22,384 INFO GSet: 354 - Computing capacity for map BlocksMap 14:32:22,385 INFO GSet: 355 - VM type = 64-bit 14:32:22,386 INFO GSet: 356 - 2.0% max memory 3.3 GB = 66.9 MB 14:32:22,386 INFO GSet: 361 - capacity = 2^23 = 8388608 entries 14:32:22,405 INFO BlockManager: 349 - dfs.block.access.token.enable=false 14:32:22,405 INFO BlockManager: 334 - defaultReplication = 1 14:32:22,405 INFO BlockManager: 335 - maxReplication = 512 14:32:22,406 INFO BlockManager: 336 - minReplication = 1 14:32:22,406 INFO BlockManager: 337 - maxReplicationStreams = 2 14:32:22,406 INFO BlockManager: 338 - shouldCheckForEnoughRacks = false 14:32:22,406 INFO BlockManager: 339 - replicationRecheckInterval = 3000 14:32:22,406 INFO BlockManager: 340 - encryptDataTransfer = false 14:32:22,406 INFO BlockManager: 341 - maxNumBlocksToLog = 1000 14:32:22,407 INFO FSNamesystem: 694 - fsOwner = ec2-user (auth:SIMPLE) 14:32:22,407 INFO FSNamesystem: 695 - supergroup = supergroup 14:32:22,407 INFO FSNamesystem: 696 - isPermissionEnabled = true 14:32:22,408 INFO FSNamesystem: 707 - HA Enabled: false 14:32:22,410 INFO FSNamesystem: 744 - Append Enabled: true 14:32:22,557 INFO GSet: 354 - Computing capacity for map INodeMap 14:32:22,557 INFO GSet: 355 - VM type = 64-bit 14:32:22,557 INFO GSet: 356 - 1.0% max memory 3.3 GB = 33.4 MB 14:32:22,557 INFO GSet: 361 - capacity = 2^22 = 4194304 entries 14:32:22,560 INFO NameNode: 204 - Caching file names occuring more than 10 times 14:32:22,564 INFO GSet: 354 - Computing capacity for map cachedBlocks 14:32:22,564 INFO GSet: 355 - VM type = 64-bit 14:32:22,565 INFO GSet: 356 - 0.25% max memory 3.3 GB = 8.4 MB 14:32:22,565 INFO GSet: 361 - capacity = 2^20 = 1048576 entries 14:32:22,566 INFO FSNamesystem:4720 - dfs.namenode.safemode.threshold-pct = 0.9990000128746033 14:32:22,566 INFO FSNamesystem:4721 - dfs.namenode.safemode.min.datanodes = 0 14:32:22,567 INFO FSNamesystem:4722 - dfs.namenode.safemode.extension = 0 14:32:22,567 INFO FSNamesystem: 828 - Retry cache on namenode is enabled 14:32:22,568 INFO FSNamesystem: 836 - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 14:32:22,569 INFO GSet: 354 - Computing capacity for map NameNodeRetryCache 14:32:22,569 INFO GSet: 355 - VM type = 64-bit 14:32:22,570 INFO GSet: 356 - 0.029999999329447746% max memory 3.3 GB = 1.0 MB 14:32:22,570 INFO GSet: 361 - capacity = 2^17 = 131072 entries 14:32:22,574 INFO AclConfigFlag: 40 - ACLs enabled? false 14:32:22,608 INFO FSImage: 145 - Allocated new BlockPoolId: BP-1004616600-10.0.26.168-1502548342579 14:32:22,621 INFO Storage: 550 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1 has been successfully formatted. 14:32:22,625 INFO Storage: 550 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name2 has been successfully formatted. 14:32:22,718 INFO NNStorageRetentionManager: 201 - Going to retain 1 images with txid >= 0 14:32:22,720 INFO NameNode:1298 - createNameNode [] 14:32:22,743 WARN MetricsConfig: 124 - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 14:32:22,818 INFO NameNode: 337 - fs.defaultFS is hdfs://127.0.0.1:0 14:32:22,836 INFO DFSUtil:1654 - Starting web server as: ${dfs.web.authentication.kerberos.principal} 14:32:22,836 INFO DFSUtil:1665 - Starting Web-server for hdfs at: http://localhost:0 14:32:22,868 INFO log: 67 - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 14:32:22,872 INFO HttpRequestLog: 80 - Http request log for http.requests.namenode is not defined 14:32:22,882 INFO HttpServer2: 667 - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 14:32:22,883 INFO HttpServer2: 645 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs 14:32:22,884 INFO HttpServer2: 652 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 14:32:22,884 INFO HttpServer2: 652 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 14:32:22,896 INFO HttpServer2: 86 - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter) 14:32:22,897 INFO HttpServer2: 571 - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 14:32:22,907 INFO HttpServer2: 855 - Jetty bound to port 40259 14:32:22,908 INFO log: 67 - jetty-6.1.26 14:32:22,924 INFO log: 67 - Extract jar:file:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_40259_hdfs____.g1b6d8/webapp 14:32:23,021 WARN AuthenticationFilter: 162 - 'signature.secret' configuration not set, using a random value as secret 14:32:23,049 INFO log: 67 - Started SelectChannelConnector@localhost:40259 14:32:23,050 INFO FSNamesystem: 677 - fsLock is fair:true 14:32:23,050 INFO HostFileManager: 304 - read includes: HostSet( ) 14:32:23,050 INFO HostFileManager: 311 - read excludes: HostSet( ) 14:32:23,050 INFO DatanodeManager: 234 - dfs.block.invalidate.limit=1000 14:32:23,050 INFO DatanodeManager: 240 - dfs.namenode.datanode.registration.ip-hostname-check=true 14:32:23,051 INFO GSet: 354 - Computing capacity for map BlocksMap 14:32:23,051 INFO GSet: 355 - VM type = 64-bit 14:32:23,051 INFO GSet: 356 - 2.0% max memory 3.3 GB = 66.9 MB 14:32:23,051 INFO GSet: 361 - capacity = 2^23 = 8388608 entries 14:32:23,057 INFO BlockManager: 349 - dfs.block.access.token.enable=false 14:32:23,057 INFO BlockManager: 334 - defaultReplication = 1 14:32:23,057 INFO BlockManager: 335 - maxReplication = 512 14:32:23,058 INFO BlockManager: 336 - minReplication = 1 14:32:23,058 INFO BlockManager: 337 - maxReplicationStreams = 2 14:32:23,058 INFO BlockManager: 338 - shouldCheckForEnoughRacks = false 14:32:23,058 INFO BlockManager: 339 - replicationRecheckInterval = 3000 14:32:23,058 INFO BlockManager: 340 - encryptDataTransfer = false 14:32:23,058 INFO BlockManager: 341 - maxNumBlocksToLog = 1000 14:32:23,058 INFO FSNamesystem: 694 - fsOwner = ec2-user (auth:SIMPLE) 14:32:23,058 INFO FSNamesystem: 695 - supergroup = supergroup 14:32:23,059 INFO FSNamesystem: 696 - isPermissionEnabled = true 14:32:23,059 INFO FSNamesystem: 707 - HA Enabled: false 14:32:23,059 INFO FSNamesystem: 744 - Append Enabled: true 14:32:23,059 INFO GSet: 354 - Computing capacity for map INodeMap 14:32:23,060 INFO GSet: 355 - VM type = 64-bit 14:32:23,060 INFO GSet: 356 - 1.0% max memory 3.3 GB = 33.4 MB 14:32:23,060 INFO GSet: 361 - capacity = 2^22 = 4194304 entries 14:32:23,062 INFO NameNode: 204 - Caching file names occuring more than 10 times 14:32:23,062 INFO GSet: 354 - Computing capacity for map cachedBlocks 14:32:23,062 INFO GSet: 355 - VM type = 64-bit 14:32:23,063 INFO GSet: 356 - 0.25% max memory 3.3 GB = 8.4 MB 14:32:23,063 INFO GSet: 361 - capacity = 2^20 = 1048576 entries 14:32:23,063 INFO FSNamesystem:4720 - dfs.namenode.safemode.threshold-pct = 0.9990000128746033 14:32:23,063 INFO FSNamesystem:4721 - dfs.namenode.safemode.min.datanodes = 0 14:32:23,064 INFO FSNamesystem:4722 - dfs.namenode.safemode.extension = 0 14:32:23,064 INFO FSNamesystem: 828 - Retry cache on namenode is enabled 14:32:23,064 INFO FSNamesystem: 836 - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 14:32:23,064 INFO GSet: 354 - Computing capacity for map NameNodeRetryCache 14:32:23,064 INFO GSet: 355 - VM type = 64-bit 14:32:23,064 INFO GSet: 356 - 0.029999999329447746% max memory 3.3 GB = 1.0 MB 14:32:23,065 INFO GSet: 361 - capacity = 2^17 = 131072 entries 14:32:23,066 INFO AclConfigFlag: 40 - ACLs enabled? false 14:32:23,069 INFO Storage: 702 - Lock on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1/in_use.lock acquired by nodename 31978@ip-10-0-26-168 14:32:23,073 INFO Storage: 702 - Lock on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name2/in_use.lock acquired by nodename 31978@ip-10-0-26-168 14:32:23,074 INFO FileJournalManager: 322 - Recovering unfinalized segments in /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1/current 14:32:23,074 INFO FileJournalManager: 322 - Recovering unfinalized segments in /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name2/current 14:32:23,075 INFO FSImage: 642 - No edit log streams selected. 14:32:23,084 INFO FSImageFormatPBINode: 173 - Loading 1 INodes. 14:32:23,088 INFO FSImageFormatProtobuf: 170 - Loaded FSImage in 0 seconds. 14:32:23,089 INFO FSImage: 915 - Loaded image for txid 0 from /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1/current/fsimage_0000000000000000000 14:32:23,092 INFO FSNamesystem: 897 - Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false) 14:32:23,092 INFO FSEditLog:1112 - Starting log segment at 1 14:32:23,146 INFO NameCache: 143 - initialized with 0 entries 0 lookups 14:32:23,147 INFO FSNamesystem: 645 - Finished loading FSImage in 81 msecs 14:32:23,248 INFO NameNode: 295 - RPC server is binding to localhost:0 14:32:23,252 INFO CallQueueManager: 53 - Using callQueue class java.util.concurrent.LinkedBlockingQueue 14:32:23,261 INFO Server: 593 - Starting Socket Reader #1 for port 36309 14:32:23,280 INFO NameNode: 567 - Clients are to use localhost:36309 to access this namenode/service. 14:32:23,282 INFO FSNamesystem:5651 - Registered FSNamesystemState MBean 14:32:23,289 INFO FSNamesystem:5307 - Number of blocks under construction: 0 14:32:23,290 INFO FSNamesystem:5307 - Number of blocks under construction: 0 14:32:23,290 INFO FSNamesystem:1067 - initializing replication queues 14:32:23,290 INFO StateChange:4794 - STATE* Leaving safe mode after 0 secs 14:32:23,290 INFO StateChange:4805 - STATE* Network topology has 0 racks and 0 datanodes 14:32:23,290 INFO StateChange:4808 - STATE* UnderReplicatedBlocks has 0 blocks 14:32:23,295 INFO BlockManager:2489 - Total number of blocks = 0 14:32:23,295 INFO BlockManager:2490 - Number of invalid blocks = 0 14:32:23,295 INFO BlockManager:2491 - Number of under-replicated blocks = 0 14:32:23,295 INFO BlockManager:2492 - Number of over-replicated blocks = 0 14:32:23,295 INFO BlockManager:2494 - Number of blocks being written = 0 14:32:23,295 INFO StateChange:2495 - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 5 msec 14:32:23,307 INFO Server: 815 - IPC Server Responder: starting 14:32:23,307 INFO Server: 662 - IPC Server listener on 36309: starting 14:32:23,309 INFO NameNode: 609 - NameNode RPC up at: localhost/127.0.0.1:36309 14:32:23,309 INFO FSNamesystem: 997 - Starting services required for active state 14:32:23,312 INFO CacheReplicationMonitor: 159 - Starting CacheReplicationMonitor with interval 30000 milliseconds 14:32:23,312 INFO CacheReplicationMonitor: 172 - Rescanning because of pending operations 14:32:23,312 INFO MiniDFSCluster:1290 - Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1,[DISK]file:/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2 14:32:23,312 INFO CacheReplicationMonitor: 202 - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s). 14:32:23,327 INFO DataNode: 288 - Configured hostname is 127.0.0.1 14:32:23,328 INFO DataNode: 764 - Starting DataNode with maxLockedMemory = 0 14:32:23,332 INFO DataNode: 564 - Opened streaming server at /127.0.0.1:39997 14:32:23,333 INFO DataNode: 73 - Balancing bandwith is 1048576 bytes/s 14:32:23,339 INFO HttpRequestLog: 80 - Http request log for http.requests.datanode is not defined 14:32:23,339 INFO HttpServer2: 667 - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 14:32:23,340 INFO HttpServer2: 645 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode 14:32:23,340 INFO HttpServer2: 652 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 14:32:23,340 INFO HttpServer2: 652 - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 14:32:23,343 INFO HttpServer2: 571 - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 14:32:23,343 INFO HttpServer2: 855 - Jetty bound to port 33273 14:32:23,343 INFO log: 67 - jetty-6.1.26 14:32:23,346 INFO log: 67 - Extract jar:file:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_33273_datanode____d8mec5/webapp 14:32:23,412 INFO log: 67 - Started SelectChannelConnector@localhost:33273 14:32:23,413 INFO DataNode: 781 - dnUserName = ec2-user 14:32:23,413 INFO DataNode: 782 - supergroup = supergroup 14:32:23,420 INFO CallQueueManager: 53 - Using callQueue class java.util.concurrent.LinkedBlockingQueue 14:32:23,420 INFO Server: 593 - Starting Socket Reader #1 for port 41659 14:32:23,423 INFO DataNode: 439 - Opened IPC server at /127.0.0.1:41659 14:32:23,428 INFO DataNode: 152 - Refresh request received for nameservices: null 14:32:23,429 INFO DataNode: 197 - Starting BPOfferServices for nameservices: 14:32:23,434 INFO DataNode: 809 - Block pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:36309 starting to offer service 14:32:23,435 INFO Server: 815 - IPC Server Responder: starting 14:32:23,435 INFO Server: 662 - IPC Server listener on 41659: starting 14:32:23,570 INFO Server: 589 - Served: versionRequest queueTime= 24 procesingTime= 16 14:32:23,593 INFO Storage: 173 - Data-node version: -55 and name-node layout version: -56 14:32:23,596 INFO Storage: 702 - Lock on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/in_use.lock acquired by nodename 31978@ip-10-0-26-168 14:32:23,596 INFO Storage: 197 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1 is not formatted 14:32:23,597 INFO Storage: 198 - Formatting ... 14:32:23,601 INFO Storage: 702 - Lock on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/in_use.lock acquired by nodename 31978@ip-10-0-26-168 14:32:23,601 INFO Storage: 197 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2 is not formatted 14:32:23,601 INFO Storage: 198 - Formatting ... 14:32:23,624 INFO Storage: 108 - Analyzing storage directories for bpid BP-1004616600-10.0.26.168-1502548342579 14:32:23,624 INFO Storage: 666 - Locking is disabled 14:32:23,625 INFO Storage: 130 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current/BP-1004616600-10.0.26.168-1502548342579 is not formatted. 14:32:23,625 INFO Storage: 131 - Formatting ... 14:32:23,625 INFO Storage: 183 - Formatting block pool BP-1004616600-10.0.26.168-1502548342579 directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current/BP-1004616600-10.0.26.168-1502548342579/current 14:32:23,637 INFO Storage: 666 - Locking is disabled 14:32:23,638 INFO Storage: 130 - Storage directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579 is not formatted. 14:32:23,638 INFO Storage: 131 - Formatting ... 14:32:23,638 INFO Storage: 183 - Formatting block pool BP-1004616600-10.0.26.168-1502548342579 directory /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579/current 14:32:23,641 INFO Storage: 254 - Restored 0 block files from trash. 14:32:23,641 INFO Storage: 254 - Restored 0 block files from trash. 14:32:23,643 INFO DataNode: 976 - Setting up storage: nsid=1922949254;bpid=BP-1004616600-10.0.26.168-1502548342579;lv=-55;nsInfo=lv=-56;cid=testClusterID;nsid=1922949254;c=0;bpid=BP-1004616600-10.0.26.168-1502548342579;dnuuid=null 14:32:23,647 INFO DataNode: 809 - Generated and persisted new Datanode UUID f8aaac6a-af90-433b-922f-95eca64b7fad 14:32:23,658 INFO FsDatasetImpl: 216 - Added volume - /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current, StorageType: DISK 14:32:23,658 INFO FsDatasetImpl: 216 - Added volume - /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current, StorageType: DISK 14:32:23,659 INFO Server: 589 - Served: getDatanodeReport queueTime= 13 procesingTime= 3 14:32:23,660 INFO MiniDFSCluster:2062 - dnInfo.length != numDataNodes 14:32:23,660 INFO MiniDFSCluster:2014 - Waiting for cluster to become active 14:32:23,664 INFO FsDatasetImpl:1378 - Registered FSDatasetState MBean 14:32:23,667 INFO DirectoryScanner: 330 - Periodic Directory Tree Verification scan starting at 1502550659667 with interval 21600000 14:32:23,667 INFO FsDatasetImpl:1747 - Adding block pool BP-1004616600-10.0.26.168-1502548342579 14:32:23,667 INFO FsDatasetImpl: 207 - Scanning block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current... 14:32:23,667 INFO FsDatasetImpl: 207 - Scanning block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current... 14:32:23,690 INFO FsDatasetImpl: 212 - Time taken to scan block pool BP-1004616600-10.0.26.168-1502548342579 on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current: 23ms 14:32:23,690 INFO FsDatasetImpl: 212 - Time taken to scan block pool BP-1004616600-10.0.26.168-1502548342579 on /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current: 22ms 14:32:23,690 INFO FsDatasetImpl: 236 - Total time to scan all replicas for block pool BP-1004616600-10.0.26.168-1502548342579: 23ms 14:32:23,691 INFO FsDatasetImpl: 108 - Adding replicas to map for block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current... 14:32:23,691 INFO FsDatasetImpl: 108 - Adding replicas to map for block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current... 14:32:23,691 INFO FsDatasetImpl: 113 - Time to add replicas to map for block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current: 0ms 14:32:23,691 INFO FsDatasetImpl: 113 - Time to add replicas to map for block pool BP-1004616600-10.0.26.168-1502548342579 on volume /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current: 0ms 14:32:23,691 INFO FsDatasetImpl: 136 - Total time to add all replicas to map: 1ms 14:32:23,692 INFO DataNode: 769 - Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid null) service to localhost/127.0.0.1:36309 beginning handshake with NN 14:32:23,698 INFO StateChange: 822 - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=f8aaac6a-af90-433b-922f-95eca64b7fad, infoPort=33273, ipcPort=41659, storageInfo=lv=-55;cid=testClusterID;nsid=1922949254;c=0) storage f8aaac6a-af90-433b-922f-95eca64b7fad 14:32:23,701 INFO NetworkTopology: 413 - Adding a new node: /default-rack/127.0.0.1:39997 14:32:23,702 INFO Server: 589 - Served: registerDatanode queueTime= 1 procesingTime= 4 14:32:23,703 INFO DataNode: 782 - Block pool Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid null) service to localhost/127.0.0.1:36309 successfully registered with NN 14:32:23,703 INFO DataNode: 641 - For namenode localhost/127.0.0.1:36309 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000 14:32:23,710 INFO DatanodeDescriptor: 667 - Adding new storage ID DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e for DN 127.0.0.1:39997 14:32:23,710 INFO DatanodeDescriptor: 667 - Adding new storage ID DS-77001532-fa37-475a-813c-2e2438e379a7 for DN 127.0.0.1:39997 14:32:23,716 INFO Server: 589 - Served: sendHeartbeat queueTime= 1 procesingTime= 6 14:32:23,717 INFO DataNode: 439 - Namenode Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid f8aaac6a-af90-433b-922f-95eca64b7fad) service to localhost/127.0.0.1:36309 trying to claim ACTIVE state with txid=1 14:32:23,717 INFO DataNode: 451 - Acknowledging ACTIVE Namenode Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid f8aaac6a-af90-433b-922f-95eca64b7fad) service to localhost/127.0.0.1:36309 14:32:23,724 INFO BlockManager:1707 - BLOCK* processReport: Received first block report from org.apache.hadoop.hdfs.server.protocol.DatanodeStorage@9170e8 after starting up or becoming active. Its block contents are no longer considered stale 14:32:23,724 INFO BlockStateChange:1723 - BLOCK* processReport: from storage DS-77001532-fa37-475a-813c-2e2438e379a7 node DatanodeRegistration(127.0.0.1, datanodeUuid=f8aaac6a-af90-433b-922f-95eca64b7fad, infoPort=33273, ipcPort=41659, storageInfo=lv=-55;cid=testClusterID;nsid=1922949254;c=0), blocks: 0, processing time: 1 msecs 14:32:23,724 INFO BlockManager:1707 - BLOCK* processReport: Received first block report from org.apache.hadoop.hdfs.server.protocol.DatanodeStorage@160c2787 after starting up or becoming active. Its block contents are no longer considered stale 14:32:23,724 INFO BlockStateChange:1723 - BLOCK* processReport: from storage DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e node DatanodeRegistration(127.0.0.1, datanodeUuid=f8aaac6a-af90-433b-922f-95eca64b7fad, infoPort=33273, ipcPort=41659, storageInfo=lv=-55;cid=testClusterID;nsid=1922949254;c=0), blocks: 0, processing time: 0 msecs 14:32:23,736 INFO Server: 589 - Served: blockReport queueTime= 1 procesingTime= 13 14:32:23,737 INFO DataNode: 502 - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 19 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@51f91b66 14:32:23,737 INFO DataNode: 618 - Got finalize command for block pool BP-1004616600-10.0.26.168-1502548342579 14:32:23,739 INFO GSet: 354 - Computing capacity for map BlockMap 14:32:23,739 INFO GSet: 355 - VM type = 64-bit 14:32:23,740 INFO GSet: 356 - 0.5% max memory 3.3 GB = 16.7 MB 14:32:23,740 INFO GSet: 361 - capacity = 2^21 = 2097152 entries 14:32:23,741 INFO BlockPoolSliceScanner: 186 - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1004616600-10.0.26.168-1502548342579 14:32:23,743 INFO DataBlockScanner: 265 - Added bpid=BP-1004616600-10.0.26.168-1502548342579 to blockPoolScannerMap, new size=1 14:32:23,763 INFO Server: 589 - Served: getDatanodeReport queueTime= 0 procesingTime= 2 14:32:23,766 INFO MiniDFSCluster:2045 - Cluster is active 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:host.name=ip-10-0-26-168.ec2.internal 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:java.version=1.8.0_121 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:java.vendor=Oracle Corporation 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:java.home=/usr/java/jdk1.8.0_121/jre 14:32:23,782 INFO ZooKeeperServer: 100 - Server environment:java.class.path=/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-classes:/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/classes:/home/ec2-user/flink-upstream/flink-core/target/flink-core-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-annotations/target/flink-annotations-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-metrics/flink-metrics-core/target/flink-metrics-core-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/flink/flink-shaded-asm/5.0.4-1.0/flink-shaded-asm-5.0.4-1.0.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/ec2-user/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/home/ec2-user/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/ec2-user/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/ec2-user/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/ec2-user/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/ec2-user/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/ec2-user/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar:/home/ec2-user/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.3/snappy-java-1.1.1.3.jar:/home/ec2-user/flink-upstream/flink-java/target/flink-java-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/home/ec2-user/flink-upstream/flink-scala/target/flink-scala_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-reflect/2.11.11/scala-reflect-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-library/2.11.11/scala-library-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-compiler/2.11.11/scala-compiler-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.0.5/scala-xml_2.11-1.0.5.jar:/home/ec2-user/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/home/ec2-user/flink-upstream/flink-streaming-scala/target/flink-streaming-scala_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-libraries/flink-table/target/flink-table_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/codehaus/janino/janino/3.0.7/janino-3.0.7.jar:/home/ec2-user/.m2/repository/org/codehaus/janino/commons-compiler/3.0.7/commons-compiler-3.0.7.jar:/home/ec2-user/.m2/repository/org/apache/calcite/calcite-core/1.13.0/calcite-core-1.13.0.jar:/home/ec2-user/.m2/repository/org/apache/calcite/avatica/avatica-core/1.10.0/avatica-core-1.10.0.jar:/home/ec2-user/.m2/repository/org/apache/calcite/calcite-linq4j/1.13.0/calcite-linq4j-1.13.0.jar:/home/ec2-user/.m2/repository/net/hydromatic/aggdesigner-algorithm/6.0/aggdesigner-algorithm-6.0.jar:/home/ec2-user/.m2/repository/org/reflections/reflections/0.9.10/reflections-0.9.10.jar:/home/ec2-user/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/ec2-user/.m2/repository/joda-time/joda-time/2.5/joda-time-2.5.jar:/home/ec2-user/flink-upstream/flink-shaded-hadoop/flink-shaded-hadoop2/target/flink-shaded-hadoop2-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar:/usr/java/jdk1.8.0_121/jre/../lib/tools.jar:/home/ec2-user/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/ec2-user/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/ec2-user/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.4.6/httpcore-4.4.6.jar:/home/ec2-user/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/home/ec2-user/.m2/repository/commons-configuration/commons-configuration/1.7/commons-configuration-1.7.jar:/home/ec2-user/.m2/repository/commons-digester/commons-digester/1.8.1/commons-digester-1.8.1.jar:/home/ec2-user/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/home/ec2-user/.m2/repository/commons-beanutils/commons-beanutils-bean-collections/1.8.3/commons-beanutils-bean-collections-1.8.3.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar:/home/ec2-user/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/ec2-user/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/ec2-user/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/ec2-user/flink-upstream/flink-streaming-java/target/flink-streaming-java_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-runtime/target/flink-runtime_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/flink/flink-shaded-netty/4.0.27.Final-1.0/flink-shaded-netty-4.0.27.Final-1.0.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-actor_2.11/2.3-custom/flakka-actor_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-remote_2.11/2.3-custom/flakka-remote_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-slf4j_2.11/2.3-custom/flakka-slf4j_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.0.2/grizzled-slf4j_2.11-1.0.2.jar:/home/ec2-user/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.7.4/jackson-core-2.7.4.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.7.4/jackson-databind-2.7.4.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.7.4/jackson-annotations-2.7.4.jar:/home/ec2-user/.m2/repository/com/twitter/chill_2.11/0.7.4/chill_2.11-0.7.4.jar:/home/ec2-user/.m2/repository/com/twitter/chill-java/0.7.4/chill-java-0.7.4.jar:/home/ec2-user/flink-upstream/flink-shaded-curator/flink-shaded-curator-recipes/target/flink-shaded-curator-recipes-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-recipes/2.12.0/curator-recipes-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-framework/2.12.0/curator-framework-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-client/2.12.0/curator-client-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/sling/org.apache.sling.commons.json/2.0.6/org.apache.sling.commons.json-2.0.6.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-common/1.3.1/hbase-common-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-protocol/1.3.1/hbase-protocol-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-procedure/1.3.1/hbase-procedure-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-common/1.3.1/hbase-common-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-client/1.3.1/hbase-client-1.3.1.jar:/home/ec2-user/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/home/ec2-user/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-prefix-tree/1.3.1/hbase-prefix-tree-1.3.1.jar:/home/ec2-user/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop-compat/1.3.1/hbase-hadoop-compat-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop2-compat/1.3.1/hbase-hadoop2-compat-1.3.1.jar:/home/ec2-user/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/home/ec2-user/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/home/ec2-user/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/home/ec2-user/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/ec2-user/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/home/ec2-user/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/ec2-user/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/ec2-user/.m2/repository/org/apache/zookeeper/zookeeper/3.4.10/zookeeper-3.4.10.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/ec2-user/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/ec2-user/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/ec2-user/.m2/repository/org/jamon/jamon-runtime/2.4.1/jamon-runtime-2.4.1.jar:/home/ec2-user/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/home/ec2-user/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/ec2-user/.m2/repository/com/lmax/disruptor/3.3.0/disruptor-3.3.0.jar:/home/ec2-user/flink-upstream/flink-clients/target/flink-clients_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-optimizer/target/flink-optimizer_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-connectors/flink-hadoop-compatibility/target/flink-hadoop-compatibility_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.5.3/httpclient-4.5.3.jar:/home/ec2-user/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/ec2-user/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/ec2-user/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/ec2-user/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-client/2.5.1/hadoop-client-2.5.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-minicluster/2.4.1/hadoop-minicluster-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1-tests.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/home/ec2-user/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/ec2-user/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-tests/2.4.1/hadoop-yarn-server-tests-2.4.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.4.1/hadoop-yarn-server-nodemanager-2.4.1.jar:/home/ec2-user/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/home/ec2-user/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/ec2-user/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.4.1/hadoop-yarn-server-resourcemanager-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.4.1/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/home/ec2-user/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar:/home/ec2-user/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/home/ec2-user/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.4.1/hadoop-yarn-server-web-proxy-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-hs/2.4.1/hadoop-mapreduce-client-hs-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop-compat/1.3.1/hbase-hadoop-compat-1.3.1-tests.jar:/home/ec2-user/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1-tests.jar:/home/ec2-user/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/home/ec2-user/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/ec2-user/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/ec2-user/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop2-compat/1.3.1/hbase-hadoop2-compat-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-annotations/1.3.1/hbase-annotations-1.3.1.jar:/home/ec2-user/flink-upstream/flink-test-utils-parent/flink-test-utils/target/flink-test-utils_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-test-utils-parent/flink-test-utils-junit/target/flink-test-utils-junit-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-test/2.12.0/curator-test-2.12.0.jar:/home/ec2-user/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/ec2-user/flink-upstream/tools/force-shading/target/force-shading-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/ec2-user/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/ec2-user/.m2/repository/org/mockito/mockito-all/1.10.19/mockito-all-1.10.19.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-module-junit4/1.6.5/powermock-module-junit4-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-module-junit4-common/1.6.5/powermock-module-junit4-common-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-core/1.6.5/powermock-core-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-reflect/1.6.5/powermock-reflect-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-mockito/1.6.5/powermock-api-mockito-1.6.5.jar:/home/ec2-user/.m2/repository/org/mockito/mockito-core/1.10.19/mockito-core-1.10.19.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-mockito-common/1.6.5/powermock-api-mockito-common-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-support/1.6.5/powermock-api-support-1.6.5.jar:/home/ec2-user/.m2/repository/org/hamcrest/hamcrest-all/1.3/hamcrest-all-1.3.jar:/home/ec2-user/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/ec2-user/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar: 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:java.io.tmpdir=/tmp 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:java.compiler= 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:os.name=Linux 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:os.arch=amd64 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:os.version=4.9.20-10.30.amzn1.x86_64 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:user.name=ec2-user 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:user.home=/home/ec2-user 14:32:23,783 INFO ZooKeeperServer: 100 - Server environment:user.dir=/home/ec2-user/flink-upstream/flink-connectors/flink-hbase 14:32:23,793 INFO ZooKeeperServer: 173 - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/zookeeper_0/version-2 snapdir /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/zookeeper_0/version-2 14:32:23,796 INFO NIOServerCnxnFactory: 89 - binding to port 0.0.0.0/0.0.0.0:54877 14:32:23,809 ERROR ZooKeeperServer: 472 - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 14:32:23,811 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34278 14:32:23,817 INFO ServerCnxn: 318 - The list of known four letter word commands is : [{1936881266=srvr, 1937006964=stat, 2003003491=wchc, 1685417328=dump, 1668445044=crst, 1936880500=srst, 1701738089=envi, 1668247142=conf, 2003003507=wchs, 2003003504=wchp, 1668247155=cons, 1835955314=mntr, 1769173615=isro, 1920298859=ruok, 1735683435=gtmk, 1937010027=stmk}] 14:32:23,817 INFO ServerCnxn: 319 - The list of enabled four letter word commands is : [[wchs, stat, stmk, conf, ruok, mntr, srvr, envi, srst, isro, dump, gtmk, crst, cons]] 14:32:23,817 INFO NIOServerCnxn: 883 - Processing stat command from /127.0.0.1:34278 14:32:23,818 INFO NIOServerCnxn: 674 - Stat command output 14:32:23,819 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34278 (no session established for client) 14:32:23,819 INFO MiniZooKeeperCluster: 276 - Started MiniZooKeeperCluster and ran successful 'stat' on client port=54877 14:32:23,921 INFO HFileSystem: 275 - Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 14:32:23,922 INFO HFileSystem: 275 - Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 14:32:23,927 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3cdst=null perm=null 14:32:23,927 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 1 14:32:23,942 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3cdst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:23,944 INFO Server: 589 - Served: mkdirs queueTime= 1 procesingTime= 12 14:32:23,961 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.version dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:23,962 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 8 14:32:24,031 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.version. BP-1004616600-10.0.26.168-1502548342579 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:24,039 INFO Server: 589 - Served: addBlock queueTime= 1 procesingTime= 10 14:32:24,047 INFO Server: 589 - Served: getServerDefaults queueTime= 1 procesingTime= 4 14:32:24,062 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741825_1001 src: /127.0.0.1:45598 dest: /127.0.0.1:39997 14:32:24,068 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:24,082 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 2 14:32:24,104 INFO clienttrace:1215 - src: /127.0.0.1:45598, dest: /127.0.0.1:39997, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1140193617_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741825_1001, duration: 25839600 14:32:24,104 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:24,105 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:24,107 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 3 14:32:24,108 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.version is closed by DFSClient_NONMAPREDUCE_-1140193617_1 14:32:24,110 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 3 14:32:24,115 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.version dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.version perm=ec2-user:supergroup:rw-r--r-- 14:32:24,116 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 4 14:32:24,117 INFO FSUtils: 747 - Created version file at hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c with version=8 14:32:24,319 INFO RSRpcServices: 108 - master/ip-10-0-26-168.ec2.internal/10.0.26.168:0 server-side HConnection retries=350 14:32:24,327 INFO SimpleRpcScheduler: 196 - Using fifo as user call queue, count=3 14:32:24,336 INFO RpcServer: 677 - master/ip-10-0-26-168.ec2.internal/10.0.26.168:0: started 10 reader(s) listening on port=36259 14:32:24,374 INFO HFileSystem: 275 - Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 14:32:24,417 INFO RecoverableZooKeeper: 120 - Process identifier=master:36259 connecting to ZooKeeper ensemble=localhost:54877 14:32:24,421 INFO ZooKeeper: 100 - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT 14:32:24,421 INFO ZooKeeper: 100 - Client environment:host.name=ip-10-0-26-168.ec2.internal 14:32:24,421 INFO ZooKeeper: 100 - Client environment:java.version=1.8.0_121 14:32:24,421 INFO ZooKeeper: 100 - Client environment:java.vendor=Oracle Corporation 14:32:24,421 INFO ZooKeeper: 100 - Client environment:java.home=/usr/java/jdk1.8.0_121/jre 14:32:24,421 INFO ZooKeeper: 100 - Client environment:java.class.path=/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-classes:/home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/classes:/home/ec2-user/flink-upstream/flink-core/target/flink-core-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-annotations/target/flink-annotations-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-metrics/flink-metrics-core/target/flink-metrics-core-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/flink/flink-shaded-asm/5.0.4-1.0/flink-shaded-asm-5.0.4-1.0.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/ec2-user/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/home/ec2-user/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/ec2-user/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/ec2-user/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/ec2-user/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/ec2-user/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/ec2-user/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar:/home/ec2-user/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.3/snappy-java-1.1.1.3.jar:/home/ec2-user/flink-upstream/flink-java/target/flink-java-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/home/ec2-user/flink-upstream/flink-scala/target/flink-scala_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-reflect/2.11.11/scala-reflect-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-library/2.11.11/scala-library-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/scala-compiler/2.11.11/scala-compiler-2.11.11.jar:/home/ec2-user/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.0.5/scala-xml_2.11-1.0.5.jar:/home/ec2-user/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/home/ec2-user/flink-upstream/flink-streaming-scala/target/flink-streaming-scala_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-libraries/flink-table/target/flink-table_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/codehaus/janino/janino/3.0.7/janino-3.0.7.jar:/home/ec2-user/.m2/repository/org/codehaus/janino/commons-compiler/3.0.7/commons-compiler-3.0.7.jar:/home/ec2-user/.m2/repository/org/apache/calcite/calcite-core/1.13.0/calcite-core-1.13.0.jar:/home/ec2-user/.m2/repository/org/apache/calcite/avatica/avatica-core/1.10.0/avatica-core-1.10.0.jar:/home/ec2-user/.m2/repository/org/apache/calcite/calcite-linq4j/1.13.0/calcite-linq4j-1.13.0.jar:/home/ec2-user/.m2/repository/net/hydromatic/aggdesigner-algorithm/6.0/aggdesigner-algorithm-6.0.jar:/home/ec2-user/.m2/repository/org/reflections/reflections/0.9.10/reflections-0.9.10.jar:/home/ec2-user/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/ec2-user/.m2/repository/joda-time/joda-time/2.5/joda-time-2.5.jar:/home/ec2-user/flink-upstream/flink-shaded-hadoop/flink-shaded-hadoop2/target/flink-shaded-hadoop2-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar:/usr/java/jdk1.8.0_121/jre/../lib/tools.jar:/home/ec2-user/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/ec2-user/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/ec2-user/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.4.6/httpcore-4.4.6.jar:/home/ec2-user/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/home/ec2-user/.m2/repository/commons-configuration/commons-configuration/1.7/commons-configuration-1.7.jar:/home/ec2-user/.m2/repository/commons-digester/commons-digester/1.8.1/commons-digester-1.8.1.jar:/home/ec2-user/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/home/ec2-user/.m2/repository/commons-beanutils/commons-beanutils-bean-collections/1.8.3/commons-beanutils-bean-collections-1.8.3.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar:/home/ec2-user/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/ec2-user/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/ec2-user/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/ec2-user/flink-upstream/flink-streaming-java/target/flink-streaming-java_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-runtime/target/flink-runtime_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/flink/flink-shaded-netty/4.0.27.Final-1.0/flink-shaded-netty-4.0.27.Final-1.0.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-actor_2.11/2.3-custom/flakka-actor_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-remote_2.11/2.3-custom/flakka-remote_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/home/ec2-user/.m2/repository/com/data-artisans/flakka-slf4j_2.11/2.3-custom/flakka-slf4j_2.11-2.3-custom.jar:/home/ec2-user/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.0.2/grizzled-slf4j_2.11-1.0.2.jar:/home/ec2-user/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.7.4/jackson-core-2.7.4.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.7.4/jackson-databind-2.7.4.jar:/home/ec2-user/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.7.4/jackson-annotations-2.7.4.jar:/home/ec2-user/.m2/repository/com/twitter/chill_2.11/0.7.4/chill_2.11-0.7.4.jar:/home/ec2-user/.m2/repository/com/twitter/chill-java/0.7.4/chill-java-0.7.4.jar:/home/ec2-user/flink-upstream/flink-shaded-curator/flink-shaded-curator-recipes/target/flink-shaded-curator-recipes-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-recipes/2.12.0/curator-recipes-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-framework/2.12.0/curator-framework-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-client/2.12.0/curator-client-2.12.0.jar:/home/ec2-user/.m2/repository/org/apache/sling/org.apache.sling.commons.json/2.0.6/org.apache.sling.commons.json-2.0.6.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-common/1.3.1/hbase-common-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-protocol/1.3.1/hbase-protocol-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-procedure/1.3.1/hbase-procedure-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-common/1.3.1/hbase-common-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-client/1.3.1/hbase-client-1.3.1.jar:/home/ec2-user/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/home/ec2-user/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-prefix-tree/1.3.1/hbase-prefix-tree-1.3.1.jar:/home/ec2-user/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop-compat/1.3.1/hbase-hadoop-compat-1.3.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop2-compat/1.3.1/hbase-hadoop2-compat-1.3.1.jar:/home/ec2-user/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/home/ec2-user/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/home/ec2-user/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/home/ec2-user/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/ec2-user/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/home/ec2-user/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/ec2-user/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/home/ec2-user/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/ec2-user/.m2/repository/org/apache/zookeeper/zookeeper/3.4.10/zookeeper-3.4.10.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/ec2-user/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/ec2-user/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/ec2-user/.m2/repository/org/jamon/jamon-runtime/2.4.1/jamon-runtime-2.4.1.jar:/home/ec2-user/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/home/ec2-user/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/ec2-user/.m2/repository/com/lmax/disruptor/3.3.0/disruptor-3.3.0.jar:/home/ec2-user/flink-upstream/flink-clients/target/flink-clients_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-optimizer/target/flink-optimizer_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-connectors/flink-hadoop-compatibility/target/flink-hadoop-compatibility_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/ec2-user/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.5.3/httpclient-4.5.3.jar:/home/ec2-user/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/ec2-user/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/ec2-user/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/ec2-user/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-client/2.5.1/hadoop-client-2.5.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-minicluster/2.4.1/hadoop-minicluster-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1-tests.jar:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/home/ec2-user/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/ec2-user/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-tests/2.4.1/hadoop-yarn-server-tests-2.4.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.4.1/hadoop-yarn-server-nodemanager-2.4.1.jar:/home/ec2-user/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/home/ec2-user/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/ec2-user/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.4.1/hadoop-yarn-server-resourcemanager-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.4.1/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/home/ec2-user/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar:/home/ec2-user/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/home/ec2-user/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.4.1/hadoop-yarn-server-web-proxy-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-hs/2.4.1/hadoop-mapreduce-client-hs-2.4.1.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop-compat/1.3.1/hbase-hadoop-compat-1.3.1-tests.jar:/home/ec2-user/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/home/ec2-user/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1-tests.jar:/home/ec2-user/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/home/ec2-user/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/ec2-user/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/ec2-user/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-hadoop2-compat/1.3.1/hbase-hadoop2-compat-1.3.1-tests.jar:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-annotations/1.3.1/hbase-annotations-1.3.1.jar:/home/ec2-user/flink-upstream/flink-test-utils-parent/flink-test-utils/target/flink-test-utils_2.11-1.4-SNAPSHOT.jar:/home/ec2-user/flink-upstream/flink-test-utils-parent/flink-test-utils-junit/target/flink-test-utils-junit-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/org/apache/curator/curator-test/2.12.0/curator-test-2.12.0.jar:/home/ec2-user/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/ec2-user/flink-upstream/tools/force-shading/target/force-shading-1.4-SNAPSHOT.jar:/home/ec2-user/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/ec2-user/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/ec2-user/.m2/repository/org/mockito/mockito-all/1.10.19/mockito-all-1.10.19.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-module-junit4/1.6.5/powermock-module-junit4-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-module-junit4-common/1.6.5/powermock-module-junit4-common-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-core/1.6.5/powermock-core-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-reflect/1.6.5/powermock-reflect-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-mockito/1.6.5/powermock-api-mockito-1.6.5.jar:/home/ec2-user/.m2/repository/org/mockito/mockito-core/1.10.19/mockito-core-1.10.19.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-mockito-common/1.6.5/powermock-api-mockito-common-1.6.5.jar:/home/ec2-user/.m2/repository/org/powermock/powermock-api-support/1.6.5/powermock-api-support-1.6.5.jar:/home/ec2-user/.m2/repository/org/hamcrest/hamcrest-all/1.3/hamcrest-all-1.3.jar:/home/ec2-user/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/ec2-user/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar: 14:32:24,422 INFO ZooKeeper: 100 - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 14:32:24,422 INFO ZooKeeper: 100 - Client environment:java.io.tmpdir=/tmp 14:32:24,422 INFO ZooKeeper: 100 - Client environment:java.compiler= 14:32:24,422 INFO ZooKeeper: 100 - Client environment:os.name=Linux 14:32:24,422 INFO ZooKeeper: 100 - Client environment:os.arch=amd64 14:32:24,422 INFO ZooKeeper: 100 - Client environment:os.version=4.9.20-10.30.amzn1.x86_64 14:32:24,423 INFO ZooKeeper: 100 - Client environment:user.name=ec2-user 14:32:24,423 INFO ZooKeeper: 100 - Client environment:user.home=/home/ec2-user 14:32:24,423 INFO ZooKeeper: 100 - Client environment:user.dir=/home/ec2-user/flink-upstream/flink-connectors/flink-hbase 14:32:24,424 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@706eab5d 14:32:24,434 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:24,434 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34282 14:32:24,434 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:24,439 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34282 14:32:24,441 INFO FileTxnLog: 203 - Creating new log file: log.1 14:32:24,450 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80000 with negotiated timeout 40000 for client /127.0.0.1:34282 14:32:24,450 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80000, negotiated timeout = 40000 14:32:24,502 INFO RpcServer:1000 - RpcServer.responder: starting 14:32:24,502 INFO RpcServer: 811 - RpcServer.listener,port=36259: starting 14:32:24,515 INFO HttpRequestLog: 69 - Http request log for http.requests.master is not defined 14:32:24,516 INFO HttpServer: 821 - Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 14:32:24,517 INFO HttpServer: 821 - Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 14:32:24,518 INFO HttpServer: 799 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 14:32:24,518 INFO HttpServer: 806 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 14:32:24,518 INFO HttpServer: 806 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 14:32:24,524 INFO HttpServer:1013 - Jetty bound to port 38933 14:32:24,524 INFO log: 67 - jetty-6.1.26 14:32:24,527 INFO log: 67 - Extract jar:file:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1.jar!/hbase-webapps/master to /tmp/Jetty_0_0_0_0_38933_master____.v1o9or/webapp 14:32:24,634 INFO log: 67 - Started SelectChannelConnector@0.0.0.0:38933 14:32:24,641 INFO HMaster: 431 - hbase.rootdir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c, hbase.cluster.distributed=false 14:32:24,652 INFO log: 67 - jetty-6.1.26 14:32:24,653 INFO log: 67 - Started SelectChannelConnector@0.0.0.0:38591 14:32:24,653 INFO HMaster:1838 - Adding backup master ZNode /hbase/backup-masters/ip-10-0-26-168.ec2.internal,36259,1502548344364 14:32:24,671 INFO ActiveMasterManager: 170 - Deleting ZNode for /hbase/backup-masters/ip-10-0-26-168.ec2.internal,36259,1502548344364 from backup master directory 14:32:24,675 WARN ZNodeClearer: 58 - Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 14:32:24,675 INFO ActiveMasterManager: 179 - Registered Active Master=ip-10-0-26-168.ec2.internal,36259,1502548344364 14:32:24,686 INFO Server: 589 - Served: setSafeMode queueTime= 0 procesingTime= 1 14:32:24,688 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3cdst=null perm=null 14:32:24,688 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:24,689 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3cdst=null perm=null 14:32:24,689 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:24,691 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.version dst=null perm=null 14:32:24,693 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 2 14:32:24,702 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.version dst=null perm=null 14:32:24,705 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 4 14:32:24,708 INFO RSRpcServices: 108 - regionserver/ip-10-0-26-168.ec2.internal/10.0.26.168:0 server-side HConnection retries=350 14:32:24,708 INFO SimpleRpcScheduler: 196 - Using fifo as user call queue, count=3 14:32:24,710 INFO RpcServer: 677 - regionserver/ip-10-0-26-168.ec2.internal/10.0.26.168:0: started 10 reader(s) listening on port=40509 14:32:24,712 INFO Server: 589 - Served: getServerDefaults queueTime= 1 procesingTime= 0 14:32:24,713 INFO HFileSystem: 275 - Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 14:32:24,715 INFO RecoverableZooKeeper: 120 - Process identifier=regionserver:40509 connecting to ZooKeeper ensemble=localhost:54877 14:32:24,715 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@10fda3d0 14:32:24,716 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:24,716 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:24,716 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34286 14:32:24,716 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34286 14:32:24,720 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 11, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741825_1001, duration: 590368 14:32:24,726 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80001 with negotiated timeout 40000 for client /127.0.0.1:34286 14:32:24,726 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.id dst=null perm=null 14:32:24,726 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:24,726 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80001, negotiated timeout = 40000 14:32:24,729 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.id dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:24,729 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:24,729 INFO RpcServer:1000 - RpcServer.responder: starting 14:32:24,729 INFO RpcServer: 811 - RpcServer.listener,port=40509: starting 14:32:24,733 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.id. BP-1004616600-10.0.26.168-1502548342579 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:24,734 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:24,735 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741826_1002 src: /127.0.0.1:45606 dest: /127.0.0.1:39997 14:32:24,736 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:24,736 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:24,737 INFO HttpRequestLog: 69 - Http request log for http.requests.regionserver is not defined 14:32:24,738 INFO HttpServer: 821 - Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 14:32:24,738 INFO HttpServer: 821 - Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 14:32:24,739 INFO HttpServer: 799 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 14:32:24,739 INFO HttpServer: 806 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 14:32:24,739 INFO HttpServer: 806 - Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 14:32:24,740 INFO clienttrace:1215 - src: /127.0.0.1:45606, dest: /127.0.0.1:39997, bytes: 42, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741826_1002, duration: 1151425 14:32:24,741 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:24,741 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:24,741 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:24,742 INFO HttpServer:1013 - Jetty bound to port 33785 14:32:24,742 INFO log: 67 - jetty-6.1.26 14:32:24,742 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.id is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:24,742 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:24,744 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/hbase.id dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.id perm=ec2-user:supergroup:rw-r--r-- 14:32:24,744 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:24,745 INFO log: 67 - Extract jar:file:/home/ec2-user/.m2/repository/org/apache/hbase/hbase-server/1.3.1/hbase-server-1.3.1.jar!/hbase-webapps/regionserver to /tmp/Jetty_0_0_0_0_33785_regionserver____puala8/webapp 14:32:24,745 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.id dst=null perm=null 14:32:24,745 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:24,746 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.id dst=null perm=null 14:32:24,746 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:24,748 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/hbase.id dst=null perm=null 14:32:24,748 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:24,753 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 46, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741826_1002, duration: 319116 14:32:24,778 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740 dst=null perm=null 14:32:24,779 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:24,779 INFO MasterFileSystem: 535 - BOOTSTRAP: creating hbase:meta region 14:32:24,782 INFO HRegion:6477 - creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', BLOOMFILTER => 'NONE', VERSIONS => '10', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} RootDir = hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c Table name == hbase:meta 14:32:24,787 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740 dst=null perm=null 14:32:24,787 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:24,789 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:24,789 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:24,797 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.regioninfo dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:24,797 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:24,799 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.regioninfo. BP-1004616600-10.0.26.168-1502548342579 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:24,799 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:24,800 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741827_1003 src: /127.0.0.1:45608 dest: /127.0.0.1:39997 14:32:24,801 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:24,802 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:24,805 INFO clienttrace:1215 - src: /127.0.0.1:45608, dest: /127.0.0.1:39997, bytes: 32, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741827_1003, duration: 1874643 14:32:24,805 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:24,807 INFO FSNamesystem:3108 - BLOCK* checkFileProgress: blk_1073741827_1003{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} has not reached minimal replication 1 14:32:24,807 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:24,807 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741827_1003{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 32 14:32:24,808 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 2 procesingTime= 1 14:32:24,874 INFO log: 67 - Started SelectChannelConnector@0.0.0.0:33785 14:32:24,910 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0xf39649e connecting to ZooKeeper ensemble=localhost:54877 14:32:24,910 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0x375d3974 connecting to ZooKeeper ensemble=localhost:54877 14:32:24,910 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@211417db 14:32:24,910 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@262dd6 14:32:24,910 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:24,911 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:24,911 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34292 14:32:24,911 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:24,911 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34294 14:32:24,911 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:24,911 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34294 14:32:24,912 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34292 14:32:24,914 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80002 with negotiated timeout 40000 for client /127.0.0.1:34294 14:32:24,914 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80002, negotiated timeout = 40000 14:32:24,915 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80003 with negotiated timeout 40000 for client /127.0.0.1:34292 14:32:24,915 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80003, negotiated timeout = 40000 14:32:24,915 INFO ZooKeeperRegistry: 107 - ClusterId read in ZooKeeper is null 14:32:24,915 INFO ZooKeeperRegistry: 107 - ClusterId read in ZooKeeper is null 14:32:25,209 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.regioninfo is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:25,209 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:25,217 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.regioninfo dst=null perm=null 14:32:25,217 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,258 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=null 14:32:25,258 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,260 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:25,260 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:25,268 INFO CacheConfig: 544 - Allocating LruBlockCache size=1.31 GB, blockSize=64 KB 14:32:25,273 INFO CacheConfig: 242 - Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:25,281 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:25,291 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=null 14:32:25,291 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:25,303 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:25,303 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,307 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 2 14:32:25,308 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.splits dst=null perm=null 14:32:25,309 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:25,309 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:25,315 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:25,315 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,316 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/2.seqid dst=null perm=null 14:32:25,316 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,318 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/2.seqid dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:25,318 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:25,319 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/2.seqid is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:25,319 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:25,319 INFO HRegion: 882 - Onlined 1588230740; next sequenceid=2 14:32:25,320 INFO HStore: 894 - Closed info 14:32:25,321 INFO HRegion:1552 - Closed hbase:meta,,1.1588230740 14:32:25,322 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tabledesc dst=null perm=null 14:32:25,322 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:25,322 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tmp/.tableinfo.0000000001 dst=null perm=null 14:32:25,323 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:25,324 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tmp/.tableinfo.0000000001 dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:25,324 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:25,333 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tmp/.tableinfo.0000000001. BP-1004616600-10.0.26.168-1502548342579 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:25,334 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:25,335 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741828_1004 src: /127.0.0.1:45614 dest: /127.0.0.1:39997 14:32:25,335 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:25,336 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:25,337 INFO clienttrace:1215 - src: /127.0.0.1:45614, dest: /127.0.0.1:39997, bytes: 398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741828_1004, duration: 962214 14:32:25,337 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:25,337 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:25,337 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:25,340 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tmp/.tableinfo.0000000001 is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:25,340 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:25,342 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tabledesc dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:25,342 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:25,343 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tmp/.tableinfo.0000000001 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 perm=ec2-user:supergroup:rw-r--r-- 14:32:25,343 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:25,344 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/.tabledesc dst=null perm=null 14:32:25,344 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:25,345 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp dst=null perm=null 14:32:25,346 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:25,349 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data dst=null perm=null 14:32:25,350 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:25,351 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp dst=null perm=null 14:32:25,352 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 2 14:32:25,353 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:25,353 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:25,353 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs dst=null perm=null 14:32:25,354 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:25,355 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:25,355 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:25,355 INFO HFileSystem: 275 - Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 14:32:25,361 INFO SplitLogManagerCoordination: 599 - Found 0 orphan tasks and 0 rescan nodes 14:32:25,363 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data dst=null perm=null 14:32:25,363 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:25,364 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data dst=null perm=null 14:32:25,364 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,366 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase dst=null perm=null 14:32:25,366 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:25,367 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta dst=null perm=null 14:32:25,367 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,375 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0x3f9e6be7 connecting to ZooKeeper ensemble=localhost:54877 14:32:25,375 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@319d17a6 14:32:25,376 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:25,377 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:25,377 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34298 14:32:25,378 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34298 14:32:25,382 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80004 with negotiated timeout 40000 for client /127.0.0.1:34298 14:32:25,383 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80004, negotiated timeout = 40000 14:32:25,392 INFO StochasticLoadBalancer: 156 - loading config 14:32:25,435 INFO HMaster: 662 - Server active/primary master=ip-10-0-26-168.ec2.internal,36259,1502548344364, sessionid=0x15dd6dc3bf80000, setting cluster-up flag (Was=false) 14:32:25,436 INFO HRegionServer: 803 - ClusterId : 1cf7d682-1016-4172-ac7e-9151b77332dd 14:32:25,436 INFO HRegionServer: 803 - ClusterId : 1cf7d682-1016-4172-ac7e-9151b77332dd 14:32:25,444 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80001 type:create cxid:0x7 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/hbase/flush-table-proc Error:KeeperErrorCode = NoNode for /hbase/flush-table-proc 14:32:25,455 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80001 type:create cxid:0xe zxid:0x1a txntype:-1 reqpath:n/a Error Path:/hbase/online-snapshot Error:KeeperErrorCode = NoNode for /hbase/online-snapshot 14:32:25,455 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x31 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/hbase/flush-table-proc/acquired Error:KeeperErrorCode = NodeExists for /hbase/flush-table-proc/acquired 14:32:25,470 INFO ZKProcedureUtil: 270 - Clearing all procedure znodes: /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 14:32:25,473 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.snapshot dst=null perm=null 14:32:25,473 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,475 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x37 zxid:0x20 txntype:-1 reqpath:n/a Error Path:/hbase/online-snapshot/acquired Error:KeeperErrorCode = NodeExists for /hbase/online-snapshot/acquired 14:32:25,477 INFO ZKProcedureUtil: 270 - Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 14:32:25,478 INFO MemStoreFlusher: 129 - globalMemStoreLimit=1.3 G, globalMemStoreLimitLowMark=1.2 G, maxHeap=3.3 G 14:32:25,481 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.hbase-snapshot/.tmp dst=null perm=null 14:32:25,481 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:25,483 INFO HRegionServer:1551 - CompactionChecker runs every 10sec 14:32:25,501 INFO RegionServerCoprocessorHost: 66 - System coprocessor loading is enabled 14:32:25,501 INFO RegionServerCoprocessorHost: 67 - Table coprocessor loading is enabled 14:32:25,502 INFO HRegionServer:2324 - reportForDuty to master=ip-10-0-26-168.ec2.internal,36259,1502548344364 with port=40509, startcode=1502548344712 14:32:25,503 INFO MasterCoprocessorHost: 87 - System coprocessor loading is enabled 14:32:25,517 INFO ProcedureExecutor: 491 - Starting procedure executor threads=9 14:32:25,517 INFO WALProcedureStore: 297 - Starting WAL Procedure Store lease recovery 14:32:25,518 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs dst=null perm=null 14:32:25,518 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:25,519 WARN WALProcedureStore: 962 - Log directory not found: File hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs does not exist. 14:32:25,522 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs/state-00000000000000000001.log dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:25,522 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:25,525 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs dst=null perm=null 14:32:25,525 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:25,525 INFO WALProcedureStore: 326 - Lease acquired for flushLogId: 1 14:32:25,530 INFO RecoverableZooKeeper: 120 - Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:54877 14:32:25,530 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@5e92f41d 14:32:25,531 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:25,531 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34300 14:32:25,531 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:25,532 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34300 14:32:25,533 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80005 with negotiated timeout 40000 for client /127.0.0.1:34300 14:32:25,533 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80005, negotiated timeout = 40000 14:32:25,538 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80005 type:create cxid:0x1 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/hbase/replication Error:KeeperErrorCode = NoNode for /hbase/replication 14:32:25,545 INFO ServerManager:1050 - Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 1, maximum of 1, timeout of 4500 ms, interval of 1500 ms. 14:32:25,620 INFO Server:1803 - Auth successful for ec2-user.hfs.0 (auth:SIMPLE) 14:32:25,622 INFO Server:1833 - Connection from 10.0.26.168 port: 59699 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:25,638 INFO ServerManager: 468 - Registering server=ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:25,646 INFO ServerManager:1067 - Finished waiting for region servers count to settle; checked in 1, slept for 101 ms, expecting minimum of 1, maximum of 1, master is running 14:32:25,648 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs dst=null perm=null 14:32:25,648 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:25,649 INFO HRegionServer:1386 - Config from master: hbase.rootdir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c 14:32:25,649 INFO HRegionServer:1386 - Config from master: fs.defaultFS=hdfs://localhost:36309 14:32:25,649 INFO HRegionServer:1386 - Config from master: hbase.master.info.port=38933 14:32:25,650 WARN ZNodeClearer: 58 - Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 14:32:25,650 INFO CacheConfig: 267 - Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:25,654 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:25,654 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:25,676 INFO WALFactory: 143 - Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.DefaultWALProvider 14:32:25,679 INFO MetricsRegionServerWrapperImpl: 105 - Computing regionserver metrics every 5000 milliseconds 14:32:25,691 INFO ReplicationSourceManager: 248 - Current list of replicators: [ip-10-0-26-168.ec2.internal,40509,1502548344712] other RSs: [ip-10-0-26-168.ec2.internal,40509,1502548344712] 14:32:25,721 INFO SplitLogWorker: 134 - SplitLogWorker ip-10-0-26-168.ec2.internal,40509,1502548344712 starting 14:32:25,722 INFO HeapMemoryManager: 205 - Starting HeapMemoryTuner chore. 14:32:25,725 INFO HRegionServer:1409 - Serving as ip-10-0-26-168.ec2.internal,40509,1502548344712, RpcServer on ip-10-0-26-168.ec2.internal/10.0.26.168:40509, sessionid=0x15dd6dc3bf80001 14:32:25,736 INFO RegionServerQuotaManager: 53 - Quota support disabled 14:32:26,466 INFO MetaTableLocator: 532 - Deleting hbase:meta region location in ZooKeeper 14:32:26,467 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:delete cxid:0x4b zxid:0x28 txntype:-1 reqpath:n/a Error Path:/hbase/meta-region-server Error:KeeperErrorCode = NoNode for /hbase/meta-region-server 14:32:26,476 INFO AssignmentManager:2119 - Setting node as OFFLINED in ZooKeeper for region {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 14:32:26,487 INFO ZKTableStateManager: 100 - Moving table hbase:meta state from null to ENABLED 14:32:26,498 INFO AssignmentManager:2151 - Assigning hbase:meta,,1.1588230740 to ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:26,498 INFO RegionStates:1153 - Transition {1588230740 state=OFFLINE, ts=1502548346477, server=null} to {1588230740 state=PENDING_OPEN, ts=1502548346498, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:26,513 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:26,515 INFO Server:1833 - Connection from 10.0.26.168 port: 41842 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:26,516 INFO RSRpcServices:1644 - Open hbase:meta,,1.1588230740 14:32:26,522 INFO WALFactory: 143 - Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.DefaultWALProvider 14:32:26,523 INFO ServerManager: 697 - AssignmentManager hasn't finished failover cleanup; waiting 14:32:26,525 INFO RegionStates:1153 - Transition {1588230740 state=PENDING_OPEN, ts=1502548346498, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {1588230740 state=OPENING, ts=1502548346525, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:26,532 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:26,532 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:26,534 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:26,534 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:26,535 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs dst=null perm=null 14:32:26,536 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:26,538 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:26,538 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:26,539 INFO FSHLog: 531 - WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta, suffix=.meta, logDir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712, archiveDir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs 14:32:26,540 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta dst=null perm=null 14:32:26,541 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:26,544 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:26,544 INFO Server: 589 - Served: create queueTime= 1 procesingTime= 1 14:32:26,559 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta. BP-1004616600-10.0.26.168-1502548342579 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:26,560 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:26,569 INFO Server: 589 - Served: getServerDefaults queueTime= 0 procesingTime= 0 14:32:26,570 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741829_1005 src: /127.0.0.1:45624 dest: /127.0.0.1:39997 14:32:26,570 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:26,573 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 2 procesingTime= 0 14:32:26,577 INFO StateChange:3707 - BLOCK* fsync: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta for DFSClient_NONMAPREDUCE_-1686644704_1 14:32:26,577 INFO Server: 589 - Served: fsync queueTime= 0 procesingTime= 1 14:32:26,578 INFO FSHLog:1445 - Slow sync cost: 20 ms, current pipeline: [] 14:32:26,578 INFO FSHLog: 903 - New WAL /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta 14:32:26,629 INFO RegionCoprocessorHost: 367 - Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 14:32:26,639 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.regioninfo dst=null perm=null 14:32:26,640 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:26,641 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=null 14:32:26,641 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:26,642 INFO CacheConfig: 242 - Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:26,643 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:26,644 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=null 14:32:26,644 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:26,646 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:26,647 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:26,649 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:26,649 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:26,650 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/2.seqid dst=null perm=null 14:32:26,650 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:26,651 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:26,652 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.splits dst=null perm=null 14:32:26,652 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:26,654 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:26,656 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:26,656 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:26,657 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:26,657 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:26,658 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/3.seqid dst=null perm=null 14:32:26,658 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:26,659 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/3.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:26,659 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:26,661 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/3.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:26,661 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:26,662 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/2.seqid dst=null perm=null 14:32:26,662 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:26,662 INFO HRegion: 882 - Onlined 1588230740; next sequenceid=3 14:32:26,705 INFO Server: 589 - Served: sendHeartbeat queueTime= 1 procesingTime= 0 14:32:26,706 INFO HRegionServer:1945 - Post open deploy tasks for hbase:meta,,1.1588230740 14:32:26,706 INFO MetaTableLocator: 446 - Setting hbase:meta region location in ZooKeeper as ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:26,711 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80001 type:setData cxid:0x2e zxid:0x2d txntype:-1 reqpath:n/a Error Path:/hbase/meta-region-server Error:KeeperErrorCode = NoNode for /hbase/meta-region-server 14:32:26,716 INFO RegionStates:1153 - Transition {1588230740 state=OPENING, ts=1502548346525, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {1588230740 state=OPEN, ts=1502548346716, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:26,717 INFO ZkOpenRegionCoordination: 348 - Handling OPENED of 1588230740 from ip-10-0-26-168.ec2.internal,36259,1502548344364; deleting unassigned node 14:32:26,722 INFO HMaster:1023 - hbase:meta with replicaId 0 assigned=1, rit=false, location=ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:26,755 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:26,755 INFO Server:1833 - Connection from 10.0.26.168 port: 41846 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:26,783 INFO MetaMigrationConvertingToPB: 165 - hbase:meta doesn't have any entries to update. 14:32:26,783 INFO MetaMigrationConvertingToPB: 131 - META already up-to date with PB serialization 14:32:26,789 INFO AssignmentManager: 649 - Clean cluster startup. Assigning user regions 14:32:26,790 INFO AssignmentManager: 507 - Joined the cluster in 7ms, failover=false 14:32:26,798 INFO TableNamespaceManager: 85 - Namespace table not found. Creating... 14:32:26,803 INFO HMaster:1623 - Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', VERSIONS => '10', IN_MEMORY => 'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 14:32:26,923 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs/state-00000000000000000001.log. BP-1004616600-10.0.26.168-1502548342579 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:26,923 INFO Server: 589 - Served: addBlock queueTime= 1 procesingTime= 0 14:32:26,925 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741830_1006 src: /127.0.0.1:45628 dest: /127.0.0.1:39997 14:32:26,925 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:26,928 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 1 14:32:26,933 INFO StateChange:3707 - BLOCK* fsync: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs/state-00000000000000000001.log for DFSClient_NONMAPREDUCE_1245568474_1 14:32:26,933 INFO Server: 589 - Served: fsync queueTime= 0 procesingTime= 0 14:32:26,943 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x1f2 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/hbase/table-lock/hbase:namespace Error:KeeperErrorCode = NoNode for /hbase/table-lock/hbase:namespace 14:32:27,063 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tabledesc dst=null perm=null 14:32:27,063 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:27,064 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tmp/.tableinfo.0000000001 dst=null perm=null 14:32:27,064 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,066 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tmp/.tableinfo.0000000001 dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:27,066 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:27,067 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tmp/.tableinfo.0000000001. BP-1004616600-10.0.26.168-1502548342579 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:27,067 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 0 14:32:27,069 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007 src: /127.0.0.1:45630 dest: /127.0.0.1:39997 14:32:27,069 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:27,071 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:27,074 INFO clienttrace:1215 - src: /127.0.0.1:45630, dest: /127.0.0.1:39997, bytes: 312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007, duration: 3783610 14:32:27,075 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:27,076 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:27,076 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:27,077 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tmp/.tableinfo.0000000001 is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:27,077 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:27,078 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tabledesc dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:27,078 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:27,079 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tmp/.tableinfo.0000000001 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 perm=ec2-user:supergroup:rw-r--r-- 14:32:27,079 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:27,080 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/.tabledesc dst=null perm=null 14:32:27,080 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:27,082 INFO HRegion:6477 - creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', VERSIONS => '10', IN_MEMORY => 'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} RootDir = hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp Table name == hbase:namespace 14:32:27,082 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d dst=null perm=null 14:32:27,082 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,084 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:27,084 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:27,086 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.regioninfo dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:27,086 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:27,087 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.regioninfo. BP-1004616600-10.0.26.168-1502548342579 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:27,088 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:27,089 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741832_1008 src: /127.0.0.1:45632 dest: /127.0.0.1:39997 14:32:27,089 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:27,091 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:27,094 INFO clienttrace:1215 - src: /127.0.0.1:45632, dest: /127.0.0.1:39997, bytes: 42, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741832_1008, duration: 3919899 14:32:27,094 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:27,095 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:27,095 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:27,096 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.regioninfo is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:27,096 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:27,096 INFO HRegion:1552 - Closed hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. 14:32:27,097 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:27,098 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace dst=null perm=null 14:32:27,098 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,099 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/hbase/namespace dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace perm=ec2-user:supergroup:rwxr-xr-x 14:32:27,099 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:27,260 INFO MetaTableAccessor:1199 - Added 1 14:32:27,365 INFO ZKTableStateManager: 100 - Moving table hbase:namespace state from null to ENABLING 14:32:27,369 INFO AssignmentManager:1632 - Assigning 1 region(s) to ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:27,376 INFO RegionStates:1153 - Transition {b3abc7615b11cec684be076c7f67241d state=OFFLINE, ts=1502548347371, server=null} to {b3abc7615b11cec684be076c7f67241d state=PENDING_OPEN, ts=1502548347376, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:27,378 INFO RSRpcServices:1644 - Open hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. 14:32:27,379 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/.tabledesc dst=null perm=null 14:32:27,379 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:27,380 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 dst=null perm=null 14:32:27,381 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:27,382 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 316, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007, duration: 144178 14:32:27,384 INFO ZKTableStateManager: 100 - Moving table hbase:namespace state from ENABLING to ENABLED 14:32:27,387 INFO RegionStates:1153 - Transition {b3abc7615b11cec684be076c7f67241d state=PENDING_OPEN, ts=1502548347376, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {b3abc7615b11cec684be076c7f67241d state=OPENING, ts=1502548347387, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:27,388 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:27,388 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,389 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs dst=null perm=null 14:32:27,389 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,390 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:27,390 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:27,391 INFO FSHLog: 531 - WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712, suffix=, logDir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712, archiveDir=hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs 14:32:27,392 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 dst=null perm=null 14:32:27,392 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,393 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:27,393 INFO Server: 589 - Served: create queueTime= 1 procesingTime= 0 14:32:27,395 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391. BP-1004616600-10.0.26.168-1502548342579 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:27,395 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:27,396 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741833_1009 src: /127.0.0.1:45634 dest: /127.0.0.1:39997 14:32:27,397 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:27,398 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:27,400 INFO StateChange:3707 - BLOCK* fsync: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 for DFSClient_NONMAPREDUCE_-1686644704_1 14:32:27,400 INFO Server: 589 - Served: fsync queueTime= 1 procesingTime= 0 14:32:27,400 INFO FSHLog:1445 - Slow sync cost: 6 ms, current pipeline: [] 14:32:27,400 INFO FSHLog: 903 - New WAL /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 14:32:27,404 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.regioninfo dst=null perm=null 14:32:27,404 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,405 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info dst=null perm=null 14:32:27,405 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,406 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:27,406 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:27,407 INFO CacheConfig: 242 - Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:27,407 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:27,408 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info dst=null perm=null 14:32:27,408 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:27,410 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits dst=null perm=null 14:32:27,410 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:27,411 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:27,411 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.splits dst=null perm=null 14:32:27,412 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:27,412 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:27,413 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits dst=null perm=null 14:32:27,413 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:27,414 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/2.seqid dst=null perm=null 14:32:27,414 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:27,415 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/2.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:27,415 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:27,416 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/2.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:27,416 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:27,416 INFO HRegion: 882 - Onlined b3abc7615b11cec684be076c7f67241d; next sequenceid=2 14:32:27,420 INFO HRegionServer:1945 - Post open deploy tasks for hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. 14:32:27,425 INFO MetaTableAccessor:1395 - Updated row hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. with server=ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:27,428 INFO RegionStates:1153 - Transition {b3abc7615b11cec684be076c7f67241d state=OPENING, ts=1502548347387, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {b3abc7615b11cec684be076c7f67241d state=OPEN, ts=1502548347428, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:27,464 INFO HMaster:2649 - Client=null/null creating {NAME => 'default'} 14:32:27,492 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/.tabledesc dst=null perm=null 14:32:27,492 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:27,493 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 dst=null perm=null 14:32:27,493 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:27,494 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 316, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007, duration: 209887 14:32:27,811 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:27,811 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:28,243 INFO HMaster:2649 - Client=null/null creating {NAME => 'hbase'} 14:32:28,467 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:28,467 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:28,667 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741826_1002 14:32:28,668 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741825_1001 14:32:28,668 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741827_1003 14:32:28,669 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741832_1008 14:32:28,669 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741828_1004 14:32:28,669 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741831_1007 14:32:29,116 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x216 zxid:0x41 txntype:-1 reqpath:n/a Error Path:/hbase/namespace/default Error:KeeperErrorCode = NodeExists for /hbase/namespace/default 14:32:29,119 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x219 zxid:0x43 txntype:-1 reqpath:n/a Error Path:/hbase/namespace/hbase Error:KeeperErrorCode = NodeExists for /hbase/namespace/hbase 14:32:29,121 INFO HMaster: 856 - Master has completed initialization 14:32:29,123 INFO MasterQuotaManager: 63 - Quota support disabled 14:32:29,123 INFO ZooKeeperWatcher: 231 - not a secure deployment, proceeding 14:32:29,182 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0x14ef2482 connecting to ZooKeeper ensemble=localhost:54877 14:32:29,182 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@65a48602 14:32:29,183 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:29,184 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34318 14:32:29,184 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:29,185 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34318 14:32:29,186 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80006 with negotiated timeout 40000 for client /127.0.0.1:34318 14:32:29,186 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80006, negotiated timeout = 40000 14:32:29,190 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:29,190 INFO Server:1833 - Connection from 10.0.26.168 port: 41858 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:29,195 INFO ConnectionManager$HConnectionImplementation:1712 - Closing zookeeper sessionid=0x15dd6dc3bf80006 14:32:29,195 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80006 14:32:29,206 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80006 closed 14:32:29,206 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80006 14:32:29,207 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34318 which had sessionid 0x15dd6dc3bf80006 14:32:29,232 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0x2f37f1f9 connecting to ZooKeeper ensemble=localhost:54877 14:32:29,232 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@3374b5bc 14:32:29,233 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:29,234 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34322 14:32:29,234 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:29,234 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34322 14:32:29,236 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80007 with negotiated timeout 40000 for client /127.0.0.1:34322 14:32:29,236 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80007, negotiated timeout = 40000 14:32:29,237 INFO HBaseCommonTestingUtility:1083 - Minicluster is up 14:32:29,237 INFO HBaseCommonTestingUtility:1251 - The hbase.fs.tmp.dir is set to /user/ec2-user/hbase-staging 14:32:29,254 INFO HBaseTestingClusterAutostarter: 165 - HBase minicluster: Running 14:32:29,265 INFO HBaseTestingClusterAutostarter: 95 - HBase minicluster: Creating table testTable 14:32:29,272 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:29,272 INFO Server:1833 - Connection from 10.0.26.168 port: 58420 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:29,281 INFO HMaster:1590 - Client=ec2-user//10.0.26.168 create 'testTable', {NAME => 'family1', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family2', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family3', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 14:32:29,387 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:create cxid:0x21e zxid:0x48 txntype:-1 reqpath:n/a Error Path:/hbase/table-lock/testTable Error:KeeperErrorCode = NoNode for /hbase/table-lock/testTable 14:32:29,506 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tabledesc dst=null perm=null 14:32:29,507 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:29,507 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tmp/.tableinfo.0000000001 dst=null perm=null 14:32:29,508 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,509 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tmp/.tableinfo.0000000001 dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:29,510 INFO Server: 589 - Served: create queueTime= 1 procesingTime= 1 14:32:29,512 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tmp/.tableinfo.0000000001. BP-1004616600-10.0.26.168-1502548342579 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:29,513 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:29,514 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010 src: /127.0.0.1:45644 dest: /127.0.0.1:39997 14:32:29,514 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:29,517 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:29,518 INFO clienttrace:1215 - src: /127.0.0.1:45644, dest: /127.0.0.1:39997, bytes: 788, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010, duration: 2914674 14:32:29,518 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:29,519 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:29,519 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:29,520 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tmp/.tableinfo.0000000001 is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:29,520 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:29,521 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tabledesc dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:29,521 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,522 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tmp/.tableinfo.0000000001 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tabledesc/.tableinfo.0000000001 perm=ec2-user:supergroup:rw-r--r-- 14:32:29,522 INFO Server: 589 - Served: rename queueTime= 1 procesingTime= 0 14:32:29,523 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/.tabledesc dst=null perm=null 14:32:29,523 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:29,523 INFO HRegion:6477 - creating HRegion testTable HTD == 'testTable', {NAME => 'family1', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family2', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family3', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} RootDir = hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp Table name == testTable 14:32:29,523 INFO HRegion:6477 - creating HRegion testTable HTD == 'testTable', {NAME => 'family1', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family2', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'family3', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} RootDir = hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp Table name == testTable 14:32:29,524 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=null 14:32:29,525 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,525 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=null 14:32:29,525 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,526 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:29,526 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,527 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:29,527 INFO Server: 589 - Served: mkdirs queueTime= 1 procesingTime= 0 14:32:29,528 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.regioninfo dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:29,528 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:29,529 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/.regioninfo dst=null perm=ec2-user:supergroup:rw-r--r-- 14:32:29,529 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:29,529 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.regioninfo. BP-1004616600-10.0.26.168-1502548342579 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:29,530 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:29,530 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/.regioninfo. BP-1004616600-10.0.26.168-1502548342579 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:29,531 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741835_1011 src: /127.0.0.1:45646 dest: /127.0.0.1:39997 14:32:29,531 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:29,531 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:29,538 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741836_1012 src: /127.0.0.1:45648 dest: /127.0.0.1:39997 14:32:29,538 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:29,539 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:29,542 INFO clienttrace:1215 - src: /127.0.0.1:45646, dest: /127.0.0.1:39997, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741835_1011, duration: 5118420 14:32:29,543 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:29,543 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:29,544 INFO clienttrace:1215 - src: /127.0.0.1:45648, dest: /127.0.0.1:39997, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741836_1012, duration: 4260966 14:32:29,544 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:29,545 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:29,546 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:29,546 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:29,546 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.regioninfo is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:29,546 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:29,547 INFO HRegion:1552 - Closed testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. 14:32:29,547 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/.regioninfo is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:29,547 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:29,547 INFO HRegion:1552 - Closed testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. 14:32:29,549 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:29,549 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable dst=null perm=null 14:32:29,549 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,550 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable perm=ec2-user:supergroup:rwxr-xr-x 14:32:29,550 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:29,658 INFO MetaTableAccessor:1199 - Added 2 14:32:29,704 INFO Server: 589 - Served: sendHeartbeat queueTime= 1 procesingTime= 0 14:32:29,763 INFO ZKTableStateManager: 100 - Moving table testTable state from null to ENABLING 14:32:29,767 INFO AssignmentManager:1632 - Assigning 2 region(s) to ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:29,772 INFO RegionStates:1153 - Transition {488bfb40330ac74164bb17a68e9c6891 state=OFFLINE, ts=1502548349767, server=null} to {488bfb40330ac74164bb17a68e9c6891 state=PENDING_OPEN, ts=1502548349772, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,773 INFO RegionStates:1153 - Transition {13b83e048c120b806088d881bcc1b120 state=OFFLINE, ts=1502548349767, server=null} to {13b83e048c120b806088d881bcc1b120 state=PENDING_OPEN, ts=1502548349773, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,773 INFO RSRpcServices:1644 - Open testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. 14:32:29,774 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/.tabledesc dst=null perm=null 14:32:29,774 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:29,775 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/.tabledesc/.tableinfo.0000000001 dst=null perm=null 14:32:29,775 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:29,777 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 796, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010, duration: 136764 14:32:29,777 INFO RSRpcServices:1644 - Open testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. 14:32:29,783 INFO RegionStates:1153 - Transition {488bfb40330ac74164bb17a68e9c6891 state=PENDING_OPEN, ts=1502548349772, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {488bfb40330ac74164bb17a68e9c6891 state=OPENING, ts=1502548349783, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,785 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.regioninfo dst=null perm=null 14:32:29,785 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,785 INFO RegionStates:1153 - Transition {13b83e048c120b806088d881bcc1b120 state=PENDING_OPEN, ts=1502548349773, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {13b83e048c120b806088d881bcc1b120 state=OPENING, ts=1502548349785, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,788 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.regioninfo dst=null perm=null 14:32:29,789 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,789 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:29,789 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,790 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:29,790 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:29,790 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,790 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,791 INFO CacheConfig: 242 - Created cacheConfig for family1: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,791 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,791 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,791 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,793 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:29,793 INFO CacheConfig: 242 - Created cacheConfig for family1: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,793 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:29,793 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,794 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:29,795 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,795 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:29,795 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:29,796 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,796 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,796 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:29,796 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,797 INFO CacheConfig: 242 - Created cacheConfig for family2: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,797 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,798 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,798 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:29,799 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:29,799 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:29,799 INFO CacheConfig: 242 - Created cacheConfig for family2: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,800 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,800 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:29,801 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:29,801 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:29,802 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:29,802 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,802 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,803 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:29,803 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:29,803 INFO CacheConfig: 242 - Created cacheConfig for family3: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,803 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,804 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:29,804 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:29,805 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:29,805 INFO CacheConfig: 242 - Created cacheConfig for family3: blockCache=LruBlockCache{blockCount=0, currentSize=1439544, freeSize=1401135688, maxSize=1402575232, heapSize=1439544, minSize=1332446464, minFactor=0.95, multiSize=666223232, multiFactor=0.5, singleSize=333111616, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 14:32:29,805 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:29,806 INFO CompactionConfiguration: 149 - size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 14:32:29,807 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:29,807 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:29,808 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:29,809 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 1 14:32:29,809 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:29,809 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,809 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:29,810 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:29,810 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.splits dst=null perm=null 14:32:29,810 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,811 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.splits dst=null perm=null 14:32:29,811 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,811 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:29,812 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:29,812 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:29,812 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,813 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:29,813 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:29,813 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/2.seqid dst=null perm=null 14:32:29,813 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:29,814 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/2.seqid dst=null perm=null 14:32:29,814 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:29,815 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/2.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:29,815 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:29,816 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/2.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:29,816 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:29,816 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/2.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:29,816 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:29,817 INFO HRegion: 882 - Onlined 488bfb40330ac74164bb17a68e9c6891; next sequenceid=2 14:32:29,817 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/2.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:29,817 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:29,818 INFO HRegion: 882 - Onlined 13b83e048c120b806088d881bcc1b120; next sequenceid=2 14:32:29,819 INFO HRegionServer:1945 - Post open deploy tasks for testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. 14:32:29,820 INFO HRegionServer:1945 - Post open deploy tasks for testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. 14:32:29,822 INFO MetaTableAccessor:1395 - Updated row testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. with server=ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:29,823 INFO MetaTableAccessor:1395 - Updated row testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. with server=ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:29,826 INFO RegionStates:1153 - Transition {488bfb40330ac74164bb17a68e9c6891 state=OPENING, ts=1502548349783, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {488bfb40330ac74164bb17a68e9c6891 state=OPEN, ts=1502548349826, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,826 INFO RegionStates:1153 - Transition {13b83e048c120b806088d881bcc1b120 state=OPENING, ts=1502548349785, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {13b83e048c120b806088d881bcc1b120 state=OPEN, ts=1502548349826, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:29,829 INFO ZKTableStateManager: 100 - Moving table testTable state from ENABLING to ENABLED 14:32:29,935 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/.tabledesc dst=null perm=null 14:32:29,935 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:29,936 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/.tabledesc/.tableinfo.0000000001 dst=null perm=null 14:32:29,936 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:29,938 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45602, bytes: 796, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010, duration: 129592 14:32:30,505 INFO HBaseAdmin: 792 - Created testTable 14:32:30,509 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:30,509 INFO Server:1833 - Connection from 10.0.26.168 port: 41870 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:30,546 INFO HBaseConnectorITCase: 43 - ================================================================================ Test testTableSourceFullScan(org.apache.flink.addons.hbase.HBaseConnectorITCase) is running. -------------------------------------------------------------------------------- 14:32:31,583 INFO TypeExtractor:1888 - class org.apache.flink.types.Row does not contain a getter for field fields 14:32:31,583 INFO TypeExtractor:1891 - class org.apache.flink.types.Row does not contain a setter for field fields 14:32:31,583 INFO TypeExtractor:1926 - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields. 14:32:31,693 ERROR HBaseConnectorITCase: 59 - -------------------------------------------------------------------------------- Test testTableSourceFullScan(org.apache.flink.addons.hbase.HBaseConnectorITCase) failed with: java.lang.NullPointerException at org.apache.calcite.plan.volcano.VolcanoPlanner.validate(VolcanoPlanner.java:891) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:866) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101) at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336) at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.changeTraits(VolcanoPlanner.java:548) at org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:365) at org.apache.flink.table.api.TableEnvironment.runVolcanoPlanner(TableEnvironment.scala:266) at org.apache.flink.table.api.BatchTableEnvironment.optimize(BatchTableEnvironment.scala:305) at org.apache.flink.table.api.BatchTableEnvironment.translate(BatchTableEnvironment.scala:335) at org.apache.flink.table.api.java.BatchTableEnvironment.toDataSet(BatchTableEnvironment.scala:146) at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceFullScan(HBaseConnectorITCase.java:168) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) ================================================================================ 14:32:31,700 INFO HBaseConnectorITCase: 43 - ================================================================================ Test testTableSourceFieldOrder(org.apache.flink.addons.hbase.HBaseConnectorITCase) is running. -------------------------------------------------------------------------------- 14:32:31,713 INFO TypeExtractor:1888 - class org.apache.flink.types.Row does not contain a getter for field fields 14:32:31,713 INFO TypeExtractor:1891 - class org.apache.flink.types.Row does not contain a setter for field fields 14:32:31,713 INFO TypeExtractor:1926 - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields. 14:32:31,717 ERROR HBaseConnectorITCase: 59 - -------------------------------------------------------------------------------- Test testTableSourceFieldOrder(org.apache.flink.addons.hbase.HBaseConnectorITCase) failed with: java.lang.NullPointerException at org.apache.calcite.plan.volcano.VolcanoPlanner.validate(VolcanoPlanner.java:891) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:866) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101) at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336) at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.changeTraits(VolcanoPlanner.java:548) at org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:365) at org.apache.flink.table.api.TableEnvironment.runVolcanoPlanner(TableEnvironment.scala:266) at org.apache.flink.table.api.BatchTableEnvironment.optimize(BatchTableEnvironment.scala:305) at org.apache.flink.table.api.BatchTableEnvironment.translate(BatchTableEnvironment.scala:335) at org.apache.flink.table.api.java.BatchTableEnvironment.toDataSet(BatchTableEnvironment.scala:146) at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceFieldOrder(HBaseConnectorITCase.java:242) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) ================================================================================ 14:32:31,718 INFO HBaseConnectorITCase: 43 - ================================================================================ Test testTableSourceProjection(org.apache.flink.addons.hbase.HBaseConnectorITCase) is running. -------------------------------------------------------------------------------- 14:32:31,727 INFO TypeExtractor:1888 - class org.apache.flink.types.Row does not contain a getter for field fields 14:32:31,727 INFO TypeExtractor:1891 - class org.apache.flink.types.Row does not contain a setter for field fields 14:32:31,728 INFO TypeExtractor:1926 - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields. 14:32:31,730 ERROR HBaseConnectorITCase: 59 - -------------------------------------------------------------------------------- Test testTableSourceProjection(org.apache.flink.addons.hbase.HBaseConnectorITCase) failed with: java.lang.NullPointerException at org.apache.calcite.plan.volcano.VolcanoPlanner.validate(VolcanoPlanner.java:891) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:866) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101) at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336) at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.changeTraits(VolcanoPlanner.java:548) at org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:365) at org.apache.flink.table.api.TableEnvironment.runVolcanoPlanner(TableEnvironment.scala:266) at org.apache.flink.table.api.BatchTableEnvironment.optimize(BatchTableEnvironment.scala:305) at org.apache.flink.table.api.BatchTableEnvironment.translate(BatchTableEnvironment.scala:335) at org.apache.flink.table.api.java.BatchTableEnvironment.toDataSet(BatchTableEnvironment.scala:146) at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceProjection(HBaseConnectorITCase.java:207) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) ================================================================================ 14:32:31,731 INFO HBaseConnectorITCase: 43 - ================================================================================ Test testTableSourceReadAsByteArray(org.apache.flink.addons.hbase.HBaseConnectorITCase) is running. -------------------------------------------------------------------------------- 14:32:31,766 INFO TypeExtractor:1888 - class org.apache.flink.types.Row does not contain a getter for field fields 14:32:31,766 INFO TypeExtractor:1891 - class org.apache.flink.types.Row does not contain a setter for field fields 14:32:31,766 INFO TypeExtractor:1926 - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields. 14:32:31,770 ERROR HBaseConnectorITCase: 59 - -------------------------------------------------------------------------------- Test testTableSourceReadAsByteArray(org.apache.flink.addons.hbase.HBaseConnectorITCase) failed with: java.lang.NullPointerException at org.apache.calcite.plan.volcano.VolcanoPlanner.validate(VolcanoPlanner.java:891) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:866) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101) at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336) at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496) at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863) at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883) at org.apache.calcite.plan.volcano.VolcanoPlanner.changeTraits(VolcanoPlanner.java:548) at org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:365) at org.apache.flink.table.api.TableEnvironment.runVolcanoPlanner(TableEnvironment.scala:266) at org.apache.flink.table.api.BatchTableEnvironment.optimize(BatchTableEnvironment.scala:305) at org.apache.flink.table.api.BatchTableEnvironment.translate(BatchTableEnvironment.scala:335) at org.apache.flink.table.api.java.BatchTableEnvironment.toDataSet(BatchTableEnvironment.scala:146) at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceReadAsByteArray(HBaseConnectorITCase.java:279) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121) ================================================================================ 14:32:31,771 INFO HBaseConnectorITCase: 43 - ================================================================================ Test testTableInputFormat(org.apache.flink.addons.hbase.HBaseConnectorITCase) is running. -------------------------------------------------------------------------------- 14:32:31,807 INFO ExecutionEnvironment:1104 - The job has 0 registered types and 0 default Kryo serializers 14:32:31,982 INFO FlinkMiniCluster: 98 - Disabled queryable state server 14:32:32,006 INFO FlinkMiniCluster: 320 - Starting FlinkMiniCluster. 14:32:32,143 WARN MetricsConfig: 124 - Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 14:32:32,220 INFO Slf4jLogger: 80 - Slf4jLogger started 14:32:32,234 INFO BlobServer: 115 - Created BLOB server storage directory /tmp/blobStore-343ba03d-c7c6-4225-9fe8-5eb28d9ad6cd 14:32:32,238 INFO BlobServer: 178 - Started BLOB server at 0.0.0.0:40129 - max concurrent requests: 50 - max backlog: 1000 14:32:32,248 INFO MetricRegistry: 94 - No metrics reporter configured, no metrics will be exposed/reported. 14:32:32,256 INFO MemoryArchivist: 128 - Started memory archivist akka://flink/user/archive_1 14:32:32,260 INFO TaskManagerConfiguration: 154 - Messages have a max timeout of 10000 ms 14:32:32,261 INFO JobManager: 128 - Starting JobManager at akka://flink/user/jobmanager_1. 14:32:32,261 INFO EmbeddedLeaderService: 273 - Proposing leadership to contender org.apache.flink.runtime.jobmanager.JobManager@3ec46f87 @ akka://flink/user/jobmanager_1 14:32:32,266 INFO TaskManagerServices: 634 - Temporary file directory '/tmp': total 7 GB, usable 4 GB (57.14% usable) 14:32:32,419 INFO JobManager: 128 - JobManager akka://flink/user/jobmanager_1 was granted leadership with leader session ID Some(684d46f3-b9d0-40e4-86b0-6eb2f5fdf303). 14:32:32,419 INFO NetworkBufferPool: 119 - Allocated 80 MB for network buffer pool (number of memory segments: 2560, bytes per segment: 32768). 14:32:32,421 INFO EmbeddedLeaderService: 227 - Received confirmation of leadership for leader akka://flink/user/jobmanager_1 , session=684d46f3-b9d0-40e4-86b0-6eb2f5fdf303 14:32:32,428 INFO StandaloneResourceManager: 431 - Trying to associate with JobManager leader akka://flink/user/jobmanager_1 14:32:32,429 INFO NetworkEnvironment: 286 - Starting the network environment and its components. 14:32:32,430 INFO TaskManagerServices: 256 - Limiting managed memory to 1073 MB, memory will be allocated lazily. 14:32:32,434 INFO IOManager: 95 - I/O manager uses directory /tmp/flink-io-5a8081ad-4197-43ac-a28f-a918dbcdb65d for spill files. 14:32:32,434 INFO StandaloneResourceManager: 489 - Resource Manager associating with leading JobManager Actor[akka://flink/user/jobmanager_1#-1252206430] - leader session 684d46f3-b9d0-40e4-86b0-6eb2f5fdf303 14:32:32,437 INFO MetricRegistry: 94 - No metrics reporter configured, no metrics will be exposed/reported. 14:32:32,444 INFO FileCache: 85 - User file cache uses directory /tmp/flink-dist-cache-838c3f10-3087-434c-b1c2-88fdd00b7dbd 14:32:32,453 INFO FileCache: 85 - User file cache uses directory /tmp/flink-dist-cache-2e209081-d733-40e8-942f-69ec5c9f5db8 14:32:32,461 INFO TaskManager: 128 - Starting TaskManager actor at akka://flink/user/taskmanager_1#-1532593470. 14:32:32,462 INFO TaskManager: 128 - TaskManager data connection information: bfe1a5cbe69c6a1dab120ef7e78d583a @ localhost (dataPort=-1) 14:32:32,462 INFO TaskManager: 128 - TaskManager has 4 task slot(s). 14:32:32,463 INFO TaskManager: 128 - Memory usage stats: [HEAP: 204/637/3344 MB, NON HEAP: 101/102/-1 MB (used/committed/max)] 14:32:32,468 INFO TaskManager: 128 - Trying to register at JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500 milliseconds) 14:32:32,470 INFO StandaloneResourceManager: 368 - TaskManager bfe1a5cbe69c6a1dab120ef7e78d583a has started. 14:32:32,473 INFO InstanceManager: 176 - Registered TaskManager at localhost (akka://flink/user/taskmanager_1) as e5bd2e39dd4b7fe7d8bad90ea9a96ad7. Current number of registered hosts is 1. Current number of alive task slots is 4. 14:32:32,475 INFO TaskManager: 128 - Successful registration at JobManager (akka://flink/user/jobmanager_1), starting network stack and library cache. 14:32:32,478 INFO TaskManager: 128 - Determined BLOB server address to be localhost/127.0.0.1:40129. Starting BLOB cache. 14:32:32,479 INFO BlobCache: 96 - Created BLOB cache storage directory /tmp/blobStore-6edc55fc-f4da-4f4f-89cd-046ab0c598ac 14:32:32,506 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,521 INFO RecoverableZooKeeper: 120 - Process identifier=hconnection-0x55061418 connecting to ZooKeeper ensemble=localhost:54877 14:32:32,521 INFO ZooKeeper: 438 - Initiating client connection, connectString=localhost:54877 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@27db45f 14:32:32,523 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:32,524 INFO ClientCnxn: 876 - Socket connection established to localhost/127.0.0.1:54877, initiating session 14:32:32,524 INFO NIOServerCnxnFactory: 192 - Accepted socket connection from /127.0.0.1:34334 14:32:32,524 INFO ZooKeeperServer: 942 - Client attempting to establish new session at /127.0.0.1:34334 14:32:32,526 INFO ZooKeeperServer: 687 - Established session 0x15dd6dc3bf80008 with negotiated timeout 40000 for client /127.0.0.1:34334 14:32:32,526 INFO ClientCnxn:1299 - Session establishment complete on server localhost/127.0.0.1:54877, sessionid = 0x15dd6dc3bf80008, negotiated timeout = 40000 14:32:32,635 INFO JobSubmissionClientActor: 238 - Received SubmitJobAndWait(JobGraph(jobId: 108efe5c8de04e01004f7fc04ae5b3d9)) but there is no connection to a JobManager yet. 14:32:32,635 INFO JobSubmissionClientActor: 97 - Received job Flink Java Job at Sat Aug 12 14:32:31 UTC 2017 (108efe5c8de04e01004f7fc04ae5b3d9). 14:32:32,635 INFO JobSubmissionClientActor: 315 - Disconnect from JobManager null. 14:32:32,638 INFO JobSubmissionClientActor: 325 - Connect to JobManager Actor[akka://flink/user/jobmanager_1#-1252206430]. 14:32:32,639 INFO JobSubmissionClientActor: 270 - Connected to JobManager at Actor[akka://flink/user/jobmanager_1#-1252206430] with leader session id 684d46f3-b9d0-40e4-86b0-6eb2f5fdf303. Connected to JobManager at Actor[akka://flink/user/jobmanager_1#-1252206430] with leader session id 684d46f3-b9d0-40e4-86b0-6eb2f5fdf303. 14:32:32,640 INFO JobSubmissionClientActor: 143 - Sending message to JobManager akka://flink/user/jobmanager_1 to submit job Flink Java Job at Sat Aug 12 14:32:31 UTC 2017 (108efe5c8de04e01004f7fc04ae5b3d9) and wait for progress 14:32:32,643 INFO JobSubmissionClientActor: 152 - Upload jar files to job manager akka://flink/user/jobmanager_1. 14:32:32,652 INFO JobSubmissionClientActor: 193 - Submit job to the job manager akka://flink/user/jobmanager_1. 14:32:32,654 INFO JobManager: 128 - Submitting job 108efe5c8de04e01004f7fc04ae5b3d9 (Flink Java Job at Sat Aug 12 14:32:31 UTC 2017). 14:32:32,659 INFO JobManager: 128 - Using restart strategy NoRestartStrategy for 108efe5c8de04e01004f7fc04ae5b3d9. 14:32:32,677 INFO ExecutionGraph: 380 - Job recovers via failover strategy: full graph restart 14:32:32,697 INFO JobManager: 138 - Running initialization on master for job Flink Java Job at Sat Aug 12 14:32:31 UTC 2017 (108efe5c8de04e01004f7fc04ae5b3d9). 14:32:32,699 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,704 INFO Server: 589 - Served: sendHeartbeat queueTime= 0 procesingTime= 0 14:32:32,715 INFO JobManager: 160 - Successfully ran initialization on master in 18 ms. 14:32:32,729 INFO Server:1803 - Auth successful for ec2-user (auth:SIMPLE) 14:32:32,729 INFO Server:1833 - Connection from 10.0.26.168 port: 41874 with version info: version: ""1.3.1"" url: ""git://mantonov-mbp1/Users/mantonov/hbase"" revision: ""930b9a55528fe45d8edce7af42fef2d35e77677a"" user: ""mantonov"" date: ""Thu Apr 6 19:45:54 PDT 2017"" src_checksum: ""a34b810bed77b3a56af797405bea7c78"" version_major: 1 version_minor: 3 14:32:32,747 INFO AbstractTableInputFormat: 239 - Created 2 splits 14:32:32,747 INFO AbstractTableInputFormat: 161 - created split (this=org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable@3a8e2f77)[0|[ip-10-0-26-168.ec2.internal:40509]|-|] 14:32:32,747 INFO AbstractTableInputFormat: 161 - created split (this=org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable@3a8e2f77)[1|[ip-10-0-26-168.ec2.internal:40509]||-] 14:32:32,754 INFO JobSubmissionClientActor: 117 - Job 108efe5c8de04e01004f7fc04ae5b3d9 was successfully submitted to the JobManager akka://flink/deadLetters. 14:32:32,754 INFO JobManager: 128 - Scheduling job 108efe5c8de04e01004f7fc04ae5b3d9 (Flink Java Job at Sat Aug 12 14:32:31 UTC 2017). 14:32:32,754 INFO ExecutionGraph:1294 - Job Flink Java Job at Sat Aug 12 14:32:31 UTC 2017 (108efe5c8de04e01004f7fc04ae5b3d9) switched from state CREATED to RUNNING. 14:32:32,756 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from CREATED to SCHEDULED. 14:32:32,756 INFO JobSubmissionClientActor: 287 - 08/12/2017 14:32:32 Job execution switched to status RUNNING. 08/12/2017 14:32:32 Job execution switched to status RUNNING. 14:32:32,756 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to SCHEDULED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to SCHEDULED 14:32:32,760 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from SCHEDULED to DEPLOYING. 14:32:32,761 INFO ExecutionGraph: 409 - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (attempt #0) to localhost 14:32:32,761 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to DEPLOYING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to DEPLOYING 14:32:32,766 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from CREATED to SCHEDULED. 14:32:32,767 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to SCHEDULED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to SCHEDULED 14:32:32,767 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from SCHEDULED to DEPLOYING. 14:32:32,767 INFO ExecutionGraph: 409 - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (attempt #0) to localhost 14:32:32,767 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to DEPLOYING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to DEPLOYING 14:32:32,767 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from CREATED to SCHEDULED. 14:32:32,767 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from SCHEDULED to DEPLOYING. 14:32:32,767 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to SCHEDULED 14:32:32,767 INFO ExecutionGraph: 409 - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (attempt #0) to localhost 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to SCHEDULED 14:32:32,768 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to DEPLOYING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to DEPLOYING 14:32:32,768 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from CREATED to SCHEDULED. 14:32:32,768 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from SCHEDULED to DEPLOYING. 14:32:32,768 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to SCHEDULED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to SCHEDULED 14:32:32,768 INFO ExecutionGraph: 409 - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (attempt #0) to localhost 14:32:32,768 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to DEPLOYING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to DEPLOYING 14:32:32,791 INFO TaskManager: 128 - Received task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) 14:32:32,793 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from CREATED to DEPLOYING. 14:32:32,793 INFO Task: 566 - Creating FileSystem stream leak safety net for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) [DEPLOYING] 14:32:32,795 INFO TaskManager: 128 - Received task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) 14:32:32,795 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from CREATED to DEPLOYING. 14:32:32,796 INFO Task: 566 - Creating FileSystem stream leak safety net for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) [DEPLOYING] 14:32:32,799 INFO Task: 571 - Loading JAR files for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) [DEPLOYING]. 14:32:32,799 INFO Task: 571 - Loading JAR files for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) [DEPLOYING]. 14:32:32,799 INFO TaskManager: 128 - Received task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) 14:32:32,800 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from CREATED to DEPLOYING. 14:32:32,800 INFO Task: 566 - Creating FileSystem stream leak safety net for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) [DEPLOYING] 14:32:32,800 INFO Task: 571 - Loading JAR files for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) [DEPLOYING]. 14:32:32,801 INFO Task: 600 - Registering task at network: CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) [DEPLOYING]. 14:32:32,801 INFO Task: 600 - Registering task at network: CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) [DEPLOYING]. 14:32:32,801 INFO Task: 600 - Registering task at network: CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) [DEPLOYING]. 14:32:32,802 INFO TaskManager: 128 - Received task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) 14:32:32,802 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from CREATED to DEPLOYING. 14:32:32,802 INFO Task: 566 - Creating FileSystem stream leak safety net for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) [DEPLOYING] 14:32:32,802 INFO Task: 571 - Loading JAR files for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) [DEPLOYING]. 14:32:32,808 INFO Task: 600 - Registering task at network: CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) [DEPLOYING]. 14:32:32,811 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from DEPLOYING to RUNNING. 14:32:32,811 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from DEPLOYING to RUNNING. 14:32:32,811 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from DEPLOYING to RUNNING. 14:32:32,811 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from DEPLOYING to RUNNING. 14:32:32,812 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,812 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,813 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,814 INFO AbstractTableInputFormat: 79 - Initializing HBaseConfiguration 14:32:32,814 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from DEPLOYING to RUNNING. 14:32:32,814 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from DEPLOYING to RUNNING. 14:32:32,814 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to RUNNING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to RUNNING 14:32:32,815 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to RUNNING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to RUNNING 14:32:32,815 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from DEPLOYING to RUNNING. 14:32:32,815 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to RUNNING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to RUNNING 14:32:32,824 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from DEPLOYING to RUNNING. 14:32:32,825 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to RUNNING 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to RUNNING 14:32:32,846 WARN MetricGroup: 137 - The operator name DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) exceeded the 80 characters length limit and was truncated. 14:32:32,847 WARN MetricGroup: 137 - The operator name DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) exceeded the 80 characters length limit and was truncated. 14:32:32,846 WARN MetricGroup: 137 - The operator name DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) exceeded the 80 characters length limit and was truncated. 14:32:32,846 WARN MetricGroup: 137 - The operator name DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) exceeded the 80 characters length limit and was truncated. 14:32:32,849 INFO LocatableInputSplitAssigner: 186 - Assigning remote split to host localhost 14:32:32,851 INFO LocatableInputSplitAssigner: 186 - Assigning remote split to host localhost 14:32:32,852 INFO AbstractTableInputFormat: 161 - opening split (this=org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable@b0480f5)[1|[ip-10-0-26-168.ec2.internal:40509]||-] 14:32:32,852 INFO AbstractTableInputFormat: 161 - opening split (this=org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable@dad6136)[0|[ip-10-0-26-168.ec2.internal:40509]|-|] 14:32:32,857 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from RUNNING to FINISHED. 14:32:32,858 INFO Task: 809 - Freeing task resources for CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636). 14:32:32,858 INFO Task: 833 - Ensuring all FileSystem streams are closed for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) [FINISHED] 14:32:32,858 INFO ExecutionGraph:1082 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from CREATED to SCHEDULED. 14:32:32,859 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to SCHEDULED 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to SCHEDULED 14:32:32,859 INFO ExecutionGraph:1082 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from SCHEDULED to DEPLOYING. 14:32:32,859 INFO ExecutionGraph: 409 - Deploying Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (attempt #0) to localhost 14:32:32,857 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from RUNNING to FINISHED. 14:32:32,861 INFO Task: 809 - Freeing task resources for CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6). 14:32:32,859 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to DEPLOYING 14:32:32,862 INFO Task: 833 - Ensuring all FileSystem streams are closed for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) [FINISHED] 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to DEPLOYING 14:32:32,861 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (a64a0da1cb9fe567845f58eaf556e636) 14:32:32,871 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (e50ea50a19cea061724d255cb38710b6) 14:32:32,874 INFO AbstractTableInputFormat: 171 - Closing split (scanned 5 rows) 14:32:32,878 INFO AbstractTableInputFormat: 171 - Closing split (scanned 3 rows) 14:32:32,879 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from RUNNING to FINISHED. 14:32:32,879 INFO Task: 809 - Freeing task resources for CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50). 14:32:32,879 INFO Task: 833 - Ensuring all FileSystem streams are closed for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) [FINISHED] 14:32:32,881 INFO Task: 940 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from RUNNING to FINISHED. 14:32:32,881 INFO Task: 809 - Freeing task resources for CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f). 14:32:32,881 INFO Task: 833 - Ensuring all FileSystem streams are closed for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) [FINISHED] 14:32:32,883 INFO TaskManager: 128 - Received task Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) 14:32:32,883 INFO Task: 940 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from CREATED to DEPLOYING. 14:32:32,883 INFO Task: 566 - Creating FileSystem stream leak safety net for task Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) [DEPLOYING] 14:32:32,884 INFO Task: 571 - Loading JAR files for task Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) [DEPLOYING]. 14:32:32,884 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (76d2105a07e12d776f443340173e6a50) 14:32:32,885 INFO Task: 600 - Registering task at network: Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) [DEPLOYING]. 14:32:32,885 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (dffb9db4055cd675df24433b97d13e6f) 14:32:32,886 INFO Task: 940 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from DEPLOYING to RUNNING. 14:32:32,887 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (3/4) (e50ea50a19cea061724d255cb38710b6) switched from RUNNING to FINISHED. 14:32:32,887 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/4) (a64a0da1cb9fe567845f58eaf556e636) switched from RUNNING to FINISHED. 14:32:32,887 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to FINISHED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(3/4) switched to FINISHED 14:32:32,887 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to FINISHED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/4) switched to FINISHED 14:32:32,888 INFO ExecutionGraph:1082 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from DEPLOYING to RUNNING. 14:32:32,889 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to RUNNING 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to RUNNING 14:32:32,890 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (4/4) (76d2105a07e12d776f443340173e6a50) switched from RUNNING to FINISHED. 14:32:32,890 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to FINISHED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(4/4) switched to FINISHED 14:32:32,890 INFO ExecutionGraph:1082 - CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (2/4) (dffb9db4055cd675df24433b97d13e6f) switched from RUNNING to FINISHED. 14:32:32,891 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to FINISHED 08/12/2017 14:32:32 CHAIN DataSource (at createInput(ExecutionEnvironment.java:550) (org.apache.flink.addons.hbase.HBaseConnectorITCase$InputFormatForTestTable)) -> Combine (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(2/4) switched to FINISHED 14:32:32,903 INFO Task: 940 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from RUNNING to FINISHED. 14:32:32,903 INFO ExecutionGraph:1082 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from CREATED to SCHEDULED. 14:32:32,903 INFO Task: 809 - Freeing task resources for Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073). 14:32:32,904 INFO ExecutionGraph:1082 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from SCHEDULED to DEPLOYING. 14:32:32,904 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to SCHEDULED 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to SCHEDULED 14:32:32,904 INFO ExecutionGraph: 409 - Deploying DataSink (collect()) (1/1) (attempt #0) to localhost 14:32:32,904 INFO Task: 833 - Ensuring all FileSystem streams are closed for task Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) [FINISHED] 14:32:32,904 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to DEPLOYING 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to DEPLOYING 14:32:32,905 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (d9aa210007d0c9d5ae01c01df707c073) 14:32:32,907 INFO TaskManager: 128 - Received task DataSink (collect()) (1/1) 14:32:32,907 INFO Task: 940 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from CREATED to DEPLOYING. 14:32:32,908 INFO Task: 566 - Creating FileSystem stream leak safety net for task DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) [DEPLOYING] 14:32:32,908 INFO Task: 571 - Loading JAR files for task DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) [DEPLOYING]. 14:32:32,909 INFO ExecutionGraph:1082 - Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342)) (1/1) (d9aa210007d0c9d5ae01c01df707c073) switched from RUNNING to FINISHED. 14:32:32,909 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to FINISHED 08/12/2017 14:32:32 Reduce (Reduce at testTableInputFormat(HBaseConnectorITCase.java:342))(1/1) switched to FINISHED 14:32:32,909 INFO Task: 600 - Registering task at network: DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) [DEPLOYING]. 14:32:32,910 INFO Task: 940 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from DEPLOYING to RUNNING. 14:32:32,910 INFO ExecutionGraph:1082 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from DEPLOYING to RUNNING. 14:32:32,911 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to RUNNING 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to RUNNING 14:32:32,916 INFO Task: 940 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from RUNNING to FINISHED. 14:32:32,916 INFO Task: 809 - Freeing task resources for DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59). 14:32:32,916 INFO Task: 833 - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) [FINISHED] 14:32:32,917 INFO TaskManager: 128 - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (026bb11eea4bfe9fb18d7820420a7f59) 14:32:32,920 INFO ExecutionGraph:1082 - DataSink (collect()) (1/1) (026bb11eea4bfe9fb18d7820420a7f59) switched from RUNNING to FINISHED. 14:32:32,920 INFO JobSubmissionClientActor: 277 - 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to FINISHED 08/12/2017 14:32:32 DataSink (collect())(1/1) switched to FINISHED 14:32:32,921 INFO ExecutionGraph:1294 - Job Flink Java Job at Sat Aug 12 14:32:31 UTC 2017 (108efe5c8de04e01004f7fc04ae5b3d9) switched from state RUNNING to FINISHED. 14:32:32,921 INFO JobSubmissionClientActor: 287 - 08/12/2017 14:32:32 Job execution switched to status FINISHED. 08/12/2017 14:32:32 Job execution switched to status FINISHED. 14:32:32,931 INFO JobSubmissionClientActor: 337 - Terminate JobClientActor. 14:32:32,931 INFO JobClient: 322 - Job execution complete 14:32:32,932 INFO JobSubmissionClientActor: 315 - Disconnect from JobManager Actor[akka://flink/user/jobmanager_1#-1252206430]. 14:32:32,935 INFO FlinkMiniCluster: 417 - Stopping FlinkMiniCluster. 14:32:32,940 INFO TaskManager: 128 - Stopping TaskManager akka://flink/user/taskmanager_1#-1532593470. 14:32:32,940 INFO JobManager: 128 - Stopping JobManager akka://flink/user/jobmanager_1. 14:32:32,940 INFO TaskManager: 128 - Disassociating from JobManager 14:32:32,942 INFO BlobCache: 227 - Shutting down BlobCache 14:32:32,944 INFO BlobServer: 323 - Stopped BLOB server at 0.0.0.0:40129 14:32:32,951 INFO IOManager: 110 - I/O manager removed spill file directory /tmp/flink-io-5a8081ad-4197-43ac-a28f-a918dbcdb65d 14:32:32,951 INFO NetworkEnvironment: 316 - Shutting down the network environment and its components. 14:32:32,961 INFO TaskManager: 128 - Task manager akka://flink/user/taskmanager_1 is completely shut down. 14:32:32,981 INFO HBaseConnectorITCase: 51 - -------------------------------------------------------------------------------- Test testTableInputFormat(org.apache.flink.addons.hbase.HBaseConnectorITCase) successfully run. ================================================================================ 14:32:32,982 INFO HBaseTestingClusterAutostarter: 241 - HBase minicluster: Shutting down 14:32:32,987 INFO HBaseAdmin:1380 - Started disable of testTable 14:32:32,991 INFO HMaster:2141 - Client=ec2-user//10.0.26.168 disable testTable 14:32:33,328 INFO ZKTableStateManager: 100 - Moving table testTable state from DISABLING to DISABLING 14:32:33,440 INFO DisableTableProcedure: 411 - Offlining 2 regions. 14:32:33,444 INFO RegionStates:1153 - Transition {488bfb40330ac74164bb17a68e9c6891 state=OPEN, ts=1502548349828, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {488bfb40330ac74164bb17a68e9c6891 state=PENDING_CLOSE, ts=1502548353444, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:33,444 INFO RegionStates:1153 - Transition {13b83e048c120b806088d881bcc1b120 state=OPEN, ts=1502548349829, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {13b83e048c120b806088d881bcc1b120 state=PENDING_CLOSE, ts=1502548353444, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:33,446 INFO RSRpcServices:1279 - Close 13b83e048c120b806088d881bcc1b120, moving to null 14:32:33,447 INFO RSRpcServices:1279 - Close 488bfb40330ac74164bb17a68e9c6891, moving to null 14:32:33,450 INFO HRegion:2256 - Flushing 3/3 column families, memstore=3.05 KB 14:32:33,450 INFO HRegion:2256 - Flushing 3/3 column families, memstore=4.73 KB 14:32:33,462 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp dst=null perm=null 14:32:33,463 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,463 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp dst=null perm=null 14:32:33,463 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,464 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:33,464 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:33,464 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:33,464 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:33,470 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:33,470 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:33,471 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:33,471 INFO Server: 589 - Served: create queueTime= 1 procesingTime= 0 14:32:33,505 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd. BP-1004616600-10.0.26.168-1502548342579 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:33,506 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:33,506 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346. BP-1004616600-10.0.26.168-1502548342579 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:33,506 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 0 14:32:33,507 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013 src: /127.0.0.1:45656 dest: /127.0.0.1:39997 14:32:33,508 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:33,510 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014 src: /127.0.0.1:45658 dest: /127.0.0.1:39997 14:32:33,511 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 2 14:32:33,511 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:33,515 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 1 14:32:33,517 INFO clienttrace:1215 - src: /127.0.0.1:45656, dest: /127.0.0.1:39997, bytes: 5091, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, duration: 7411728 14:32:33,518 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:33,518 INFO clienttrace:1215 - src: /127.0.0.1:45658, dest: /127.0.0.1:39997, bytes: 5011, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, duration: 4051981 14:32:33,518 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:33,520 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:33,520 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 2 procesingTime= 0 14:32:33,523 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:33,523 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:33,523 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:33,523 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:33,523 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=840, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd 14:32:33,524 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:33,524 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:33,524 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=504, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 14:32:33,529 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,529 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,530 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,530 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,531 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,531 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:33,532 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,532 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:33,532 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,532 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,533 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,533 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:33,533 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,533 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,534 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,534 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,534 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,534 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:33,535 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,535 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:33,539 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4535, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, duration: 132149 14:32:33,539 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4615, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, duration: 147503 14:32:33,545 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:33,546 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:33,546 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:33,547 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:33,550 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 5011, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, duration: 130277 14:32:33,550 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 5091, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, duration: 129849 14:32:33,570 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp dst=null perm=null 14:32:33,570 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,570 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp dst=null perm=null 14:32:33,571 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,571 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:33,571 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:33,572 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:33,572 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:33,575 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9. BP-1004616600-10.0.26.168-1502548342579 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:33,576 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:33,576 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c. BP-1004616600-10.0.26.168-1502548342579 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:33,577 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015 src: /127.0.0.1:45664 dest: /127.0.0.1:39997 14:32:33,577 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:33,578 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:33,581 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:33,582 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016 src: /127.0.0.1:45666 dest: /127.0.0.1:39997 14:32:33,583 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:33,586 INFO clienttrace:1215 - src: /127.0.0.1:45664, dest: /127.0.0.1:39997, bytes: 5240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, duration: 4430456 14:32:33,586 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:33,587 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:33,589 INFO clienttrace:1215 - src: /127.0.0.1:45666, dest: /127.0.0.1:39997, bytes: 5152, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, duration: 4297175 14:32:33,589 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:33,590 INFO FSNamesystem:3108 - BLOCK* checkFileProgress: blk_1073741839_1015{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} has not reached minimal replication 1 14:32:33,590 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:33,590 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741839_1015{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 5240 14:32:33,590 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:33,591 INFO FSNamesystem:3108 - BLOCK* checkFileProgress: blk_1073741840_1016{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} has not reached minimal replication 1 14:32:33,591 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:33,591 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741840_1016{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 5152 14:32:33,591 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:33,671 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741836_1012 14:32:33,671 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741834_1010 14:32:33,672 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014 14:32:33,672 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016 14:32:33,672 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013 14:32:33,672 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741835_1011 14:32:33,673 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015 14:32:33,991 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:33,991 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:33,992 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=1.4 K, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 14:32:33,992 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:33,992 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:33,992 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=1.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c 14:32:33,993 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,993 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,993 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:33,993 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,994 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,994 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:33,994 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:33,995 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:33,995 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,995 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,996 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:33,996 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,996 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,996 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:33,997 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:33,997 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:33,997 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,997 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:33,998 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:33,998 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:33,998 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4252, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, duration: 166003 14:32:33,999 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:33,999 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4164, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, duration: 95214 14:32:33,999 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,000 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,000 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,000 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 5240, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, duration: 135224 14:32:34,001 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 5152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, duration: 174749 14:32:34,002 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp dst=null perm=null 14:32:34,002 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:34,002 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp dst=null perm=null 14:32:34,002 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,003 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,003 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:34,004 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,004 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 1 14:32:34,008 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e. BP-1004616600-10.0.26.168-1502548342579 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:34,009 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:34,009 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc. BP-1004616600-10.0.26.168-1502548342579 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:34,010 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 1 14:32:34,010 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017 src: /127.0.0.1:45668 dest: /127.0.0.1:39997 14:32:34,011 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:34,011 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018 src: /127.0.0.1:45670 dest: /127.0.0.1:39997 14:32:34,012 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:34,012 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:34,018 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 2 14:32:34,020 INFO clienttrace:1215 - src: /127.0.0.1:45668, dest: /127.0.0.1:39997, bytes: 5506, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, duration: 7086868 14:32:34,021 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:34,022 INFO clienttrace:1215 - src: /127.0.0.1:45670, dest: /127.0.0.1:39997, bytes: 5260, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, duration: 7827478 14:32:34,022 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:34,023 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:34,023 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:34,023 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:34,023 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:34,024 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=2.5 K, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e 14:32:34,024 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:34,024 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:34,024 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:34,024 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:34,024 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=6, memsize=1.5 K, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc 14:32:34,025 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,025 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,025 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,025 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,025 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,026 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,026 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,026 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,027 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,027 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,027 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,027 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,028 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,028 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:34,028 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,028 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,029 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,029 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,029 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,029 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,030 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4518, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, duration: 115550 14:32:34,030 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4272, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, duration: 102582 14:32:34,031 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,031 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,031 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,032 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,032 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4994, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, duration: 102772 14:32:34,033 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 5260, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, duration: 106743 14:32:34,033 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:34,034 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,034 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:34,034 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,034 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,034 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,035 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,035 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,036 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/4816ab02ed5741be9aace989acfb18bd dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,036 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:34,036 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/6d8c0e87c4a040cbb33af5e576ddf346 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,036 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:34,037 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,037 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,037 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,037 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,038 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,038 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,038 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,038 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,039 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,039 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,039 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,039 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,040 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,040 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:34,040 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,040 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,040 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,041 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,041 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,041 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,042 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4615, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, duration: 119828 14:32:34,042 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4535, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, duration: 99232 14:32:34,042 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:34,043 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,043 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:34,043 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,044 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 5091, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741837_1013, duration: 103832 14:32:34,044 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd, entries=5, sequenceid=6, filesize=5.0 K 14:32:34,044 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 5011, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741838_1014, duration: 182903 14:32:34,045 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346, entries=3, sequenceid=6, filesize=4.9 K 14:32:34,045 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:34,045 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,046 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:34,046 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,046 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,046 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,047 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,047 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,047 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/c6cae147f3654ff8a7927a14fbf78db9 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,049 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 2 14:32:34,050 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/8f370a69a5e44f538a857ed38827464c dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,050 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:34,050 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,051 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,051 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,051 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,051 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,052 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,052 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,052 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,053 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,053 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,053 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,053 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,054 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,054 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:34,054 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,054 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,054 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,055 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,055 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,055 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,057 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45672, bytes: 4252, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, duration: 707943 14:32:34,059 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45674, bytes: 4164, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, duration: 796495 14:32:34,059 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:34,060 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,060 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:34,061 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,061 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45672, bytes: 5240, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741839_1015, duration: 166136 14:32:34,062 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45674, bytes: 5152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741840_1016, duration: 144534 14:32:34,062 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9, entries=8, sequenceid=6, filesize=5.1 K 14:32:34,062 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c, entries=6, sequenceid=6, filesize=5.0 K 14:32:34,063 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:34,063 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,063 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:34,063 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,063 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,063 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,064 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,064 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,065 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp/011a5e8ecd1244809d9e3539f62fe53e dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,065 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:34,065 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp/0e509a8173554d629a3f18ea3e8f40fc dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,065 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:34,066 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,066 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,066 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,066 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,067 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,067 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:34,067 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,067 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,068 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,068 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,069 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,069 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,069 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,069 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,070 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,070 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,070 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,070 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,071 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,071 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:34,073 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45676, bytes: 4518, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, duration: 174709 14:32:34,074 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45678, bytes: 4272, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1024, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, duration: 109969 14:32:34,074 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:34,074 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:34,074 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:34,075 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 1 14:32:34,076 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45678, bytes: 5260, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018, duration: 164496 14:32:34,076 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc, entries=9, sequenceid=6, filesize=5.1 K 14:32:34,078 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45676, bytes: 4994, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017, duration: 3298410 14:32:34,079 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e, entries=15, sequenceid=6, filesize=5.4 K 14:32:34,079 INFO HRegion:2556 - Finished memstore flush of ~3.05 KB/3120, currentsize=0 B/0 for region testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. in 630ms, sequenceid=6, compaction requested=false 14:32:34,080 INFO HRegion:2556 - Finished memstore flush of ~4.73 KB/4848, currentsize=0 B/0 for region testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. in 630ms, sequenceid=6, compaction requested=false 14:32:34,084 INFO HStore: 894 - Closed family1 14:32:34,084 INFO HStore: 894 - Closed family1 14:32:34,085 INFO HStore: 894 - Closed family2 14:32:34,086 INFO HStore: 894 - Closed family2 14:32:34,087 INFO HStore: 894 - Closed family3 14:32:34,088 INFO HStore: 894 - Closed family3 14:32:34,089 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=null 14:32:34,089 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,090 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=null 14:32:34,090 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:34,090 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:34,090 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,090 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:34,091 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:34,091 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:34,091 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:34,091 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:34,091 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:34,092 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=null perm=null 14:32:34,092 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,092 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=null perm=null 14:32:34,092 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:34,093 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,093 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:34,094 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:34,096 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 2 14:32:34,099 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:34,099 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 2 14:32:34,099 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:34,099 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:34,100 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/2.seqid dst=null perm=null 14:32:34,100 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 0 14:32:34,101 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/2.seqid dst=null perm=null 14:32:34,101 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:34,102 INFO HRegion:1552 - Closed testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891. 14:32:34,102 INFO HRegion:1552 - Closed testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120. 14:32:34,112 INFO RegionStates:1153 - Transition {488bfb40330ac74164bb17a68e9c6891 state=PENDING_CLOSE, ts=1502548353444, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {488bfb40330ac74164bb17a68e9c6891 state=OFFLINE, ts=1502548354112, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:34,113 INFO RegionStates: 639 - Offlined 488bfb40330ac74164bb17a68e9c6891 from ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:34,113 INFO RegionStates:1153 - Transition {13b83e048c120b806088d881bcc1b120 state=PENDING_CLOSE, ts=1502548353444, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} to {13b83e048c120b806088d881bcc1b120 state=OFFLINE, ts=1502548354113, server=ip-10-0-26-168.ec2.internal,40509,1502548344712} 14:32:34,113 INFO RegionStates: 639 - Offlined 13b83e048c120b806088d881bcc1b120 from ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:34,546 INFO ZKTableStateManager: 100 - Moving table testTable state from DISABLING to DISABLED 14:32:34,548 INFO DisableTableProcedure: 440 - Disabled table, testTable, is completed. 14:32:35,219 INFO HBaseAdmin:1409 - Disabled testTable 14:32:35,223 INFO HMaster:1944 - Client=ec2-user//10.0.26.168 delete testTable 14:32:35,455 INFO MetaTableAccessor:1427 - Deleted [{ENCODED => 488bfb40330ac74164bb17a68e9c6891, NAME => 'testTable,,1502548349279.488bfb40330ac74164bb17a68e9c6891.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x04'}, {ENCODED => 13b83e048c120b806088d881bcc1b120, NAME => 'testTable,\x00\x00\x00\x04,1502548349279.13b83e048c120b806088d881bcc1b120.', STARTKEY => '\x00\x00\x00\x04', ENDKEY => ''}] 14:32:35,563 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable dst=null perm=null 14:32:35,563 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,563 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp dst=null perm=null 14:32:35,563 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,564 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default dst=null perm=null 14:32:35,564 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,565 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,565 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:35,570 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=null 14:32:35,571 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:35,572 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.regioninfo dst=null perm=null 14:32:35,572 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,572 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/.tmp dst=null perm=null 14:32:35,572 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,573 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:35,573 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,574 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:35,574 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,574 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:35,574 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,575 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:35,575 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,576 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=null 14:32:35,576 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,577 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,577 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:35,578 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:35,578 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,578 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:35,578 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,579 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:35,579 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,580 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=null 14:32:35,580 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,582 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,582 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:35,583 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:35,584 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,584 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=null 14:32:35,584 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,587 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,587 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 1 14:32:35,588 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family1/6d8c0e87c4a040cbb33af5e576ddf346 perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,588 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:35,588 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:35,589 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,589 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:35,589 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,590 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:35,590 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,590 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=null 14:32:35,590 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,591 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,591 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,592 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:35,592 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,592 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=null 14:32:35,593 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,593 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,593 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,595 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family2/8f370a69a5e44f538a857ed38827464c perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,595 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:35,596 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:35,596 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,596 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:35,597 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,597 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:35,597 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,598 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=null 14:32:35,598 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,599 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,599 INFO Server: 589 - Served: mkdirs queueTime= 1 procesingTime= 0 14:32:35,599 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:35,599 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,600 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=null 14:32:35,600 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,601 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,601 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,602 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/family3/0e509a8173554d629a3f18ea3e8f40fc perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,602 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:35,602 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:35,603 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,603 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:35,603 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,604 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:35,604 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,605 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=null 14:32:35,605 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,605 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,605 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,606 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=null perm=null 14:32:35,606 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,607 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=null perm=null 14:32:35,607 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,607 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,607 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,608 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/488bfb40330ac74164bb17a68e9c6891/recovered.edits/9.seqid perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,608 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:35,609 INFO BlockStateChange:1064 - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:39997 14:32:35,609 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/488bfb40330ac74164bb17a68e9c6891 dst=null perm=null 14:32:35,610 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:35,610 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=null 14:32:35,610 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,611 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/.regioninfo dst=null perm=null 14:32:35,611 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,612 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/.tmp dst=null perm=null 14:32:35,612 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,613 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:35,613 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,613 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:35,613 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,614 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:35,614 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,615 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:35,615 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:35,615 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=null 14:32:35,615 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,616 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,616 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,617 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:35,617 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,618 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:35,618 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:35,618 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:35,619 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:35,619 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=null 14:32:35,619 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,620 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,620 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,621 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:35,621 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,621 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=null 14:32:35,622 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,622 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,622 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,623 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family1/4816ab02ed5741be9aace989acfb18bd perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,623 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:35,624 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:35,624 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,624 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:35,624 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,625 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:35,625 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,626 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=null 14:32:35,626 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,627 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,627 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,628 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:35,628 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,628 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=null 14:32:35,628 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,629 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,629 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,630 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family2/c6cae147f3654ff8a7927a14fbf78db9 perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,630 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:35,630 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:35,630 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,631 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:35,631 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,632 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:35,632 INFO Server: 589 - Served: getListing queueTime= 1 procesingTime= 0 14:32:35,632 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=null 14:32:35,632 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,633 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3 dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,633 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 0 14:32:35,634 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:35,634 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,635 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=null 14:32:35,635 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,635 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,635 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,636 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/family3/011a5e8ecd1244809d9e3539f62fe53e perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,636 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:35,637 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:35,637 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,637 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:35,638 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:35,638 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:35,638 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:35,639 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=null 14:32:35,639 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,640 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits dst=null perm=ec2-user:supergroup:rwxr-xr-x 14:32:35,640 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:35,640 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=null perm=null 14:32:35,640 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,641 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=null perm=null 14:32:35,641 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:35,642 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,642 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 0 14:32:35,643 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/archive/data/default/testTable/13b83e048c120b806088d881bcc1b120/recovered.edits/9.seqid perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:35,643 INFO Server: 589 - Served: rename queueTime= 1 procesingTime= 0 14:32:35,644 INFO BlockStateChange:1064 - BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:39997 14:32:35,644 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable/13b83e048c120b806088d881bcc1b120 dst=null perm=null 14:32:35,644 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:35,645 INFO BlockStateChange:1064 - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:39997 14:32:35,645 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/.tmp/data/default/testTable dst=null perm=null 14:32:35,645 INFO Server: 589 - Served: delete queueTime= 1 procesingTime= 0 14:32:35,704 INFO Server: 589 - Served: sendHeartbeat queueTime= 0 procesingTime= 0 14:32:35,749 INFO audit:7769 - allowed=true ugi=ec2-user (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/default/testTable dst=null perm=null 14:32:35,749 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,443 INFO HBaseAdmin: 965 - Deleted testTable 14:32:36,443 INFO HBaseCommonTestingUtility:1130 - Shutting down minicluster 14:32:36,443 INFO ConnectionManager$HConnectionImplementation:2155 - Closing master protocol: MasterService 14:32:36,444 INFO ConnectionManager$HConnectionImplementation:1712 - Closing zookeeper sessionid=0x15dd6dc3bf80007 14:32:36,444 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80007 14:32:36,445 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80007 closed 14:32:36,445 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80007 14:32:36,446 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34322 which had sessionid 0x15dd6dc3bf80007 14:32:36,456 INFO HRegionServer:1911 - STOPPED: Cluster shutdown requested 14:32:36,456 INFO HRegionServer:1007 - Stopping infoServer 14:32:36,458 INFO HRegionServer:1911 - STOPPED: Shutdown requested 14:32:36,458 INFO SplitLogWorker: 164 - Sending interrupt to stop the worker thread 14:32:36,458 INFO HRegionServer:1007 - Stopping infoServer 14:32:36,458 INFO SplitLogWorker: 146 - SplitLogWorker interrupted. Exiting. 14:32:36,459 INFO SplitLogWorker: 155 - SplitLogWorker ip-10-0-26-168.ec2.internal,40509,1502548344712 exiting 14:32:36,459 INFO log: 67 - Stopped SelectChannelConnector@0.0.0.0:0 14:32:36,459 INFO log: 67 - Stopped SelectChannelConnector@0.0.0.0:0 14:32:36,522 INFO LogRoller: 176 - LogRoller exiting. 14:32:36,559 INFO ProcedureExecutor: 536 - Stopping the procedure executor 14:32:36,559 INFO WALProcedureStore: 233 - Stopping the WAL Procedure Store 14:32:36,562 INFO HeapMemoryManager: 216 - Stopping HeapMemoryTuner chore. 14:32:36,562 INFO RegionServerFlushTableProcedureManager: 115 - Stopping region server flush procedure manager gracefully. 14:32:36,563 INFO MemStoreFlusher: 284 - MemStoreFlusher.1 exiting 14:32:36,563 INFO RegionServerSnapshotManager: 136 - Stopping RegionServerSnapshotManager gracefully. 14:32:36,563 INFO MemStoreFlusher: 284 - MemStoreFlusher.0 exiting 14:32:36,563 INFO HRegionServer:1053 - stopping server ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:36,564 INFO HRegion:2256 - Flushing 1/1 column families, memstore=344 B 14:32:36,564 INFO ConnectionManager$HConnectionImplementation:1712 - Closing zookeeper sessionid=0x15dd6dc3bf80002 14:32:36,564 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80002 14:32:36,566 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80002 closed 14:32:36,566 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34294 which had sessionid 0x15dd6dc3bf80002 14:32:36,566 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80002 14:32:36,566 INFO CompactSplitThread: 399 - Waiting for Split Thread to finish... 14:32:36,566 INFO CompactSplitThread: 399 - Waiting for Merge Thread to finish... 14:32:36,566 INFO CompactSplitThread: 399 - Waiting for Large Compaction Thread to finish... 14:32:36,567 INFO CompactSplitThread: 399 - Waiting for Small Compaction Thread to finish... 14:32:36,567 INFO HRegionServer:1288 - Waiting on 2 regions to close 14:32:36,567 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp dst=null perm=null 14:32:36,568 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:36,568 INFO HRegion:2256 - Flushing 1/1 column families, memstore=4.17 KB 14:32:36,569 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:36,569 INFO Server: 589 - Served: mkdirs queueTime= 0 procesingTime= 1 14:32:36,570 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,570 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:36,571 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp dst=null perm=null 14:32:36,571 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,573 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp dst=null perm=ec2-user.hfs.0:supergroup:rwxr-xr-x 14:32:36,574 INFO clienttrace:1215 - src: /127.0.0.1:45628, dest: /127.0.0.1:39997, bytes: 14865, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1245568474_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741830_1006, duration: 9647480968 14:32:36,574 INFO Server: 589 - Served: mkdirs queueTime= 1 procesingTime= 2 14:32:36,574 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:36,574 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 487 14:32:36,575 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:36,575 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/MasterProcWALs/state-00000000000000000001.log is closed by DFSClient_NONMAPREDUCE_1245568474_1 14:32:36,575 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:36,575 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f. BP-1004616600-10.0.26.168-1502548342579 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} 14:32:36,576 INFO HRegionServer:1053 - stopping server ip-10-0-26-168.ec2.internal,36259,1502548344364 14:32:36,576 INFO Server: 589 - Served: addBlock queueTime= 1 procesingTime= 1 14:32:36,578 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019 src: /127.0.0.1:45680 dest: /127.0.0.1:39997 14:32:36,578 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,578 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 2 14:32:36,579 INFO ConnectionManager$HConnectionImplementation:1712 - Closing zookeeper sessionid=0x15dd6dc3bf80003 14:32:36,579 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80003 14:32:36,579 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:36,580 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:36,580 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34292 which had sessionid 0x15dd6dc3bf80003 14:32:36,582 INFO StateChange:3077 - BLOCK* allocateBlock: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a. BP-1004616600-10.0.26.168-1502548342579 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} 14:32:36,582 INFO Server: 589 - Served: addBlock queueTime= 0 procesingTime= 0 14:32:36,585 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80003 closed 14:32:36,586 INFO DataNode: 598 - Receiving BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020 src: /127.0.0.1:45682 dest: /127.0.0.1:39997 14:32:36,586 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80003 14:32:36,587 INFO DataNode: 724 - Datanode 0 forwarding connect ack to upstream firstbadlink is 14:32:36,589 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 1 14:32:36,591 INFO clienttrace:1215 - src: /127.0.0.1:45680, dest: /127.0.0.1:39997, bytes: 4963, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, duration: 9288747 14:32:36,591 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:36,592 INFO clienttrace:1215 - src: /127.0.0.1:45682, dest: /127.0.0.1:39997, bytes: 5808, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, duration: 4267244 14:32:36,592 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:36,592 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 0 14:32:36,593 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 1 14:32:36,593 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,593 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:36,594 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=7, memsize=344, hasBloomFilter=true, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f 14:32:36,594 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-77001532-fa37-475a-813c-2e2438e379a7:NORMAL|RBW]]} size 0 14:32:36,594 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 1 procesingTime= 0 14:32:36,594 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,594 INFO Server: 589 - Served: complete queueTime= 1 procesingTime= 0 14:32:36,595 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,595 INFO DefaultStoreFlusher: 91 - Flushed, sequenceid=12, memsize=4.2 K, hasBloomFilter=false, into tmp file hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a 14:32:36,595 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,595 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,595 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,596 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,596 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,596 INFO HRegionServer:1081 - stopping server ip-10-0-26-168.ec2.internal,36259,1502548344364; all regions closed. 14:32:36,597 INFO HMaster:1201 - Stopping master jetty server 14:32:36,597 INFO log: 67 - Stopped SelectChannelConnector@0.0.0.0:38591 14:32:36,597 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,597 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,598 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,598 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,598 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,598 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,599 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,599 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,599 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,599 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,600 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,600 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:36,600 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,600 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,601 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 4487, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, duration: 129157 14:32:36,602 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4308, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1536, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, duration: 164729 14:32:36,602 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,602 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,603 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,603 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,604 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45672, bytes: 5296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, duration: 128259 14:32:36,604 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45674, bytes: 4963, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, duration: 106312 14:32:36,604 INFO StoreFile$Reader:1560 - Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48a54f1e1b8b4daaa130f8f29188804a 14:32:36,605 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info dst=null perm=null 14:32:36,605 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,605 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info dst=null perm=null 14:32:36,605 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,606 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,606 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,606 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,606 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,607 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/.tmp/5a907e8fd9154441870e30c8f64fd21f dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,607 INFO Server: 589 - Served: rename queueTime= 1 procesingTime= 0 14:32:36,608 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/.tmp/48a54f1e1b8b4daaa130f8f29188804a dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,608 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 1 14:32:36,608 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,608 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,608 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,609 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 1 14:32:36,609 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,609 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,610 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,610 INFO Server: 589 - Served: getBlockLocations queueTime= 1 procesingTime= 0 14:32:36,610 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,610 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,611 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,611 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,611 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,611 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,612 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,612 INFO Server: 589 - Served: getFileInfo queueTime= 1 procesingTime= 0 14:32:36,612 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,612 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,613 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,613 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,614 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45676, bytes: 4487, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, duration: 172993 14:32:36,614 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f dst=null perm=null 14:32:36,614 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45678, bytes: 4308, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 1536, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, duration: 164308 14:32:36,614 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,615 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a dst=null perm=null 14:32:36,615 INFO Server: 589 - Served: getBlockLocations queueTime= 0 procesingTime= 0 14:32:36,615 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45662, bytes: 4963, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019, duration: 175691 14:32:36,616 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/info/5a907e8fd9154441870e30c8f64fd21f, entries=2, sequenceid=7, filesize=4.8 K 14:32:36,616 INFO clienttrace: 738 - src: /127.0.0.1:39997, dest: /127.0.0.1:45660, bytes: 5296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1362416611_1, offset: 512, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020, duration: 150649 14:32:36,617 INFO StoreFile$Reader:1560 - Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48a54f1e1b8b4daaa130f8f29188804a 14:32:36,617 INFO HStore: 990 - Added hdfs://localhost:36309/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/info/48a54f1e1b8b4daaa130f8f29188804a, entries=7, sequenceid=12, filesize=5.7 K 14:32:36,617 INFO HRegion:2556 - Finished memstore flush of ~344 B/344, currentsize=0 B/0 for region hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. in 53ms, sequenceid=7, compaction requested=false 14:32:36,619 INFO HStore: 894 - Closed info 14:32:36,619 INFO HRegion:2556 - Finished memstore flush of ~4.17 KB/4272, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 51ms, sequenceid=12, compaction requested=false 14:32:36,620 INFO HStore: 894 - Closed info 14:32:36,621 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d dst=null perm=null 14:32:36,621 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,622 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740 dst=null perm=null 14:32:36,622 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,622 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits dst=null perm=null 14:32:36,622 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,623 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:36,623 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,623 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits dst=null perm=null 14:32:36,623 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:36,623 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits dst=null perm=null 14:32:36,624 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:36,624 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/10.seqid dst=null perm=null 14:32:36,624 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,624 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/15.seqid dst=null perm=null 14:32:36,624 INFO Server: 589 - Served: getFileInfo queueTime= 0 procesingTime= 0 14:32:36,625 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/10.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,625 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:36,626 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/15.seqid dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,626 INFO Server: 589 - Served: create queueTime= 0 procesingTime= 0 14:32:36,627 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/10.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,627 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:36,627 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/15.seqid is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,627 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:36,628 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/namespace/b3abc7615b11cec684be076c7f67241d/recovered.edits/2.seqid dst=null perm=null 14:32:36,630 INFO Server: 589 - Served: delete queueTime= 1 procesingTime= 2 14:32:36,630 INFO HRegion:1552 - Closed hbase:namespace,,1502548346801.b3abc7615b11cec684be076c7f67241d. 14:32:36,631 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/data/hbase/meta/1588230740/recovered.edits/3.seqid dst=null perm=null 14:32:36,631 INFO Server: 589 - Served: delete queueTime= 0 procesingTime= 1 14:32:36,631 INFO HRegion:1552 - Closed hbase:meta,,1.1588230740 14:32:36,697 INFO ChoreService: 328 - Chore service for: ip-10-0-26-168.ec2.internal,36259,1502548344364 had [[ScheduledChore: Name: ip-10-0-26-168.ec2.internal,36259,1502548344364-RegionNormalizerChore Period: 1800000 Unit: MILLISECONDS], [ScheduledChore: Name: CatalogJanitor-ip-10-0-26-168:36259 Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: HFileCleaner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: ip-10-0-26-168.ec2.internal,36259,1502548344364-BalancerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: LogsCleaner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: ip-10-0-26-168.ec2.internal,36259,1502548344364-DoMetricsChore Period: 3000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: ip-10-0-26-168.ec2.internal,36259,1502548344364-ClusterStatusChore Period: 60000 Unit: MILLISECONDS]] on shutdown 14:32:36,698 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:36,767 INFO HRegionServer:1081 - stopping server ip-10-0-26-168.ec2.internal,40509,1502548344712; all regions closed. 14:32:36,770 INFO clienttrace:1215 - src: /127.0.0.1:45624, dest: /127.0.0.1:39997, bytes: 3103, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741829_1005, duration: 10198648376 14:32:36,770 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:36,770 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 83 14:32:36,771 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 1 14:32:36,771 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,771 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 1 14:32:36,771 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:36,772 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 1 14:32:36,773 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,773 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 1 14:32:36,773 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta.1502548346540.meta perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,773 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:36,774 INFO FSHLog:1051 - Closed WAL: FSHLog ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.meta:.meta(num 1502548346540) 14:32:36,776 INFO clienttrace:1215 - src: /127.0.0.1:45634, dest: /127.0.0.1:39997, bytes: 6193, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686644704_1, offset: 0, srvID: f8aaac6a-af90-433b-922f-95eca64b7fad, blockid: BP-1004616600-10.0.26.168-1502548342579:blk_1073741833_1009, duration: 9377834600 14:32:36,776 INFO DataNode:1196 - PacketResponder: BP-1004616600-10.0.26.168-1502548342579:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating 14:32:36,776 INFO BlockStateChange:2350 - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39997 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b27d730-7a71-4554-b34e-1eb0ee042e4e:NORMAL|RBW]]} size 83 14:32:36,776 INFO Server: 589 - Served: blockReceivedAndDeleted queueTime= 0 procesingTime= 0 14:32:36,777 INFO StateChange:3010 - DIR* completeFile: /user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 is closed by DFSClient_NONMAPREDUCE_-1686644704_1 14:32:36,777 INFO Server: 589 - Served: complete queueTime= 0 procesingTime= 0 14:32:36,778 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712 dst=null perm=null 14:32:36,778 INFO Server: 589 - Served: getListing queueTime= 0 procesingTime= 0 14:32:36,779 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=setTimes src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 dst=null perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,779 INFO Server: 589 - Served: setTimes queueTime= 0 procesingTime= 1 14:32:36,779 INFO audit:7769 - allowed=true ugi=ec2-user.hfs.0 (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/WALs/ip-10-0-26-168.ec2.internal,40509,1502548344712/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 dst=/user/ec2-user/test-data/38a94e36-b97b-4e6f-b612-c7c34ad39c3c/oldWALs/ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712.1502548347391 perm=ec2-user.hfs.0:supergroup:rw-r--r-- 14:32:36,779 INFO Server: 589 - Served: rename queueTime= 0 procesingTime= 0 14:32:36,780 INFO FSHLog:1051 - Closed WAL: FSHLog ip-10-0-26-168.ec2.internal%2C40509%2C1502548344712:(num 1502548347391) 14:32:36,790 INFO Leases: 147 - RS:0;ip-10-0-26-168:40509 closing leases 14:32:36,790 INFO Leases: 150 - RS:0;ip-10-0-26-168:40509 closed leases 14:32:36,790 INFO ChoreService: 328 - Chore service for: ip-10-0-26-168.ec2.internal,40509,1502548344712 had [[ScheduledChore: Name: ip-10-0-26-168.ec2.internal,40509,1502548344712-MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ip-10-0-26-168.ec2.internal,40509,1502548344712 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 14:32:37,361 INFO ScheduledChore: 183 - Chore: SplitLogManager Timeout Monitor was stopped 14:32:37,703 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:38,407 INFO StateChange:3226 - BLOCK* BlockManager: ask 127.0.0.1:39997 to delete [blk_1073741834_1010, blk_1073741835_1011, blk_1073741836_1012] 14:32:38,674 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741841_1017 14:32:38,675 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741844_1020 14:32:38,675 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741843_1019 14:32:38,675 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741833_1009 14:32:38,676 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741842_1018 14:32:38,676 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741830_1006 14:32:38,676 INFO BlockPoolSliceScanner: 429 - Verification succeeded for BP-1004616600-10.0.26.168-1502548342579:blk_1073741829_1005 14:32:38,707 INFO Server: 589 - Served: sendHeartbeat queueTime= 0 procesingTime= 4 14:32:38,708 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:38,708 INFO FsDatasetAsyncDiskService: 157 - Scheduling blk_1073741834_1010 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741834 for deletion 14:32:38,709 INFO FsDatasetAsyncDiskService: 157 - Scheduling blk_1073741835_1011 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741835 for deletion 14:32:38,709 INFO FsDatasetAsyncDiskService: 233 - Deleted BP-1004616600-10.0.26.168-1502548342579 blk_1073741834_1010 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741834 14:32:38,709 INFO FsDatasetAsyncDiskService: 157 - Scheduling blk_1073741836_1012 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741836 for deletion 14:32:38,709 INFO FsDatasetAsyncDiskService: 233 - Deleted BP-1004616600-10.0.26.168-1502548342579 blk_1073741835_1011 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data1/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741835 14:32:38,710 INFO FsDatasetAsyncDiskService: 233 - Deleted BP-1004616600-10.0.26.168-1502548342579 blk_1073741836_1012 file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/data/data2/current/BP-1004616600-10.0.26.168-1502548342579/current/finalized/blk_1073741836 14:32:39,603 WARN MetricsConfig: 124 - Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 14:32:39,712 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:40,716 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:41,703 INFO Server: 589 - Served: sendHeartbeat queueTime= 0 procesingTime= 0 14:32:41,720 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:42,725 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:43,729 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:44,704 INFO Server: 589 - Served: sendHeartbeat queueTime= 0 procesingTime= 1 14:32:44,733 INFO ServerManager: 565 - Waiting on regionserver(s) to go down ip-10-0-26-168.ec2.internal,40509,1502548344712 14:32:45,689 INFO LogRoller: 176 - LogRoller exiting. 14:32:45,690 INFO Leases: 147 - regionserver/ip-10-0-26-168.ec2.internal/10.0.26.168:0.leaseChecker closing leases 14:32:45,690 INFO Leases: 150 - regionserver/ip-10-0-26-168.ec2.internal/10.0.26.168:0.leaseChecker closed leases 14:32:45,696 INFO RpcServer:2446 - Stopping server on 40509 14:32:45,696 INFO RpcServer: 858 - RpcServer.listener,port=40509: stopping 14:32:45,696 INFO RpcServer:1101 - RpcServer.responder: stopped 14:32:45,696 INFO RpcServer:1004 - RpcServer.responder: stopping 14:32:45,715 INFO RegionServerTracker: 118 - RegionServer ephemeral node deleted, processing expiration [ip-10-0-26-168.ec2.internal,40509,1502548344712] 14:32:45,716 INFO ServerManager: 620 - Cluster shutdown set; ip-10-0-26-168.ec2.internal,40509,1502548344712 expired; onlineServers=0 14:32:45,716 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80001 14:32:45,717 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80001 closed 14:32:45,717 INFO HRegionServer:1125 - stopping server ip-10-0-26-168.ec2.internal,40509,1502548344712; zookeeper connection closed. 14:32:45,717 INFO HRegionServer:1128 - RS:0;ip-10-0-26-168:40509 exiting 14:32:45,717 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80001 14:32:45,717 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34286 which had sessionid 0x15dd6dc3bf80001 14:32:45,717 INFO MiniHBaseCluster: 193 - Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@118d0da3 14:32:45,717 INFO JVMClusterUtil: 326 - Shutdown of 1 master(s) and 1 regionserver(s) complete 14:32:45,718 INFO ConnectionManager$HConnectionImplementation:1712 - Closing zookeeper sessionid=0x15dd6dc3bf80004 14:32:45,718 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80004 14:32:45,719 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80004 closed 14:32:45,719 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34298 which had sessionid 0x15dd6dc3bf80004 14:32:45,719 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80004 14:32:45,730 INFO ChoreService: 328 - Chore service for: ip-10-0-26-168.ec2.internal,36259,1502548344364_splitLogManager_ had [] on shutdown 14:32:45,730 INFO MasterFlushTableProcedureManager: 79 - stop: server shutting down. 14:32:45,730 INFO RpcServer:2446 - Stopping server on 36259 14:32:45,730 INFO RpcServer: 858 - RpcServer.listener,port=36259: stopping 14:32:45,730 INFO RpcServer:1101 - RpcServer.responder: stopped 14:32:45,731 INFO RpcServer:1004 - RpcServer.responder: stopping 14:32:45,732 INFO PrepRequestProcessor: 648 - Got user-level KeeperException when processing sessionid:0x15dd6dc3bf80000 type:delete cxid:0x2be zxid:0x70 txntype:-1 reqpath:n/a Error Path:/hbase/rs/ip-10-0-26-168.ec2.internal,36259,1502548344364 Error:KeeperErrorCode = NoNode for /hbase/rs/ip-10-0-26-168.ec2.internal,36259,1502548344364 14:32:45,734 INFO PrepRequestProcessor: 486 - Processed session termination for sessionid: 0x15dd6dc3bf80000 14:32:45,735 INFO ZooKeeper: 684 - Session: 0x15dd6dc3bf80000 closed 14:32:45,735 INFO ClientCnxn: 519 - EventThread shut down for session: 0x15dd6dc3bf80000 14:32:45,735 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34282 which had sessionid 0x15dd6dc3bf80000 14:32:45,735 INFO HRegionServer:1125 - stopping server ip-10-0-26-168.ec2.internal,36259,1502548344364; zookeeper connection closed. 14:32:45,735 INFO HRegionServer:1128 - M:0;ip-10-0-26-168:36259 exiting 14:32:45,736 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34300 which had sessionid 0x15dd6dc3bf80005 14:32:45,736 INFO ClientCnxn:1158 - Unable to read additional data from server sessionid 0x15dd6dc3bf80005, likely server has closed socket, closing socket connection and attempting reconnect 14:32:45,736 INFO NIOServerCnxn:1044 - Closed socket connection for client /127.0.0.1:34334 which had sessionid 0x15dd6dc3bf80008 14:32:45,736 INFO ClientCnxn:1158 - Unable to read additional data from server sessionid 0x15dd6dc3bf80008, likely server has closed socket, closing socket connection and attempting reconnect 14:32:45,736 INFO NIOServerCnxnFactory: 219 - NIOServerCnxn factory exited run method 14:32:45,736 INFO ZooKeeperServer: 505 - shutting down 14:32:45,736 ERROR ZooKeeperServer: 472 - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 14:32:45,736 INFO SessionTrackerImpl: 225 - Shutting down 14:32:45,736 INFO PrepRequestProcessor: 764 - Shutting down 14:32:45,736 INFO SyncRequestProcessor: 208 - Shutting down 14:32:45,736 INFO PrepRequestProcessor: 143 - PrepRequestProcessor exited loop! 14:32:45,736 INFO SyncRequestProcessor: 186 - SyncRequestProcessor exited! 14:32:45,737 INFO FinalRequestProcessor: 402 - shutdown of request processor complete 14:32:45,737 INFO MiniZooKeeperCluster: 319 - Shutdown MiniZK cluster with all ZK servers 14:32:45,737 INFO MiniDFSCluster:1546 - Shutting down the Mini HDFS Cluster 14:32:45,737 INFO MiniDFSCluster:1578 - Shutting down DataNode 0 14:32:45,737 WARN DirectoryScanner: 376 - DirectoryScanner: shutdown has been called 14:32:45,738 INFO DataNode: 240 - Closing all peers. 14:32:45,739 INFO log: 67 - Stopped SelectChannelConnector@localhost:0 14:32:45,839 INFO DataNode:1303 - Waiting for threadgroup to exit, active threads is 0 14:32:45,839 INFO Server:2398 - Stopping server on 41659 14:32:45,839 INFO Server: 694 - Stopping IPC Server listener on 41659 14:32:45,839 WARN DataNode: 726 - BPOfferService for Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid f8aaac6a-af90-433b-922f-95eca64b7fad) service to localhost/127.0.0.1:36309 interrupted 14:32:45,840 WARN DataNode: 849 - Ending block pool service for: Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid f8aaac6a-af90-433b-922f-95eca64b7fad) service to localhost/127.0.0.1:36309 14:32:45,840 INFO Server: 820 - Stopping IPC Server Responder 14:32:45,840 INFO DataNode: 103 - Removed Block pool BP-1004616600-10.0.26.168-1502548342579 (Datanode Uuid f8aaac6a-af90-433b-922f-95eca64b7fad) 14:32:45,840 INFO DataBlockScanner: 274 - Removed bpid=BP-1004616600-10.0.26.168-1502548342579 from blockPoolScannerMap 14:32:45,840 INFO FsDatasetImpl:1757 - Removing block pool BP-1004616600-10.0.26.168-1502548342579 14:32:45,841 INFO FsDatasetAsyncDiskService: 139 - Shutting down all async disk service threads 14:32:45,841 INFO FsDatasetAsyncDiskService: 147 - All async disk service threads have been shut down 14:32:45,841 INFO DataNode:1365 - Shutdown complete. 14:32:45,841 INFO FSNamesystem:1095 - Stopping services started for active state 14:32:45,841 INFO FSEditLog:1153 - Ending log segment 1 14:32:45,842 INFO FSEditLog: 673 - Number of transactions: 227 Total time for transactions(ms): 30 Number of transactions batched in Syncs: 4 Number of syncs: 153 SyncTimes(ms): 3 1 14:32:45,842 INFO FSNamesystem:4376 - NameNodeEditLogRoller was interrupted, exiting 14:32:45,842 INFO FileJournalManager: 130 - Finalizing edits file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1/current/edits_inprogress_0000000000000000001 -> /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name1/current/edits_0000000000000000001-0000000000000000227 14:32:45,843 INFO FileJournalManager: 130 - Finalizing edits file /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name2/current/edits_inprogress_0000000000000000001 -> /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/test-data/196ff5af-0e4a-405e-8691-a33c9631ee51/dfscluster_11baa4ce-defe-4d08-b149-602804f051d8/dfs/name2/current/edits_0000000000000000001-0000000000000000227 14:32:45,845 INFO CacheReplicationMonitor: 168 - Shutting down CacheReplicationMonitor 14:32:45,846 INFO Server:2398 - Stopping server on 36309 14:32:45,846 INFO Server: 694 - Stopping IPC Server listener on 36309 14:32:45,847 INFO Server: 820 - Stopping IPC Server Responder 14:32:45,847 INFO BlockManager:3363 - Stopping ReplicationMonitor. 14:32:45,847 WARN DecommissionManager: 78 - Monitor interrupted: java.lang.InterruptedException: sleep interrupted 14:32:45,855 INFO FSNamesystem:1095 - Stopping services started for active state 14:32:45,856 INFO FSNamesystem:1177 - Stopping services started for standby state 14:32:45,857 INFO log: 67 - Stopped SelectChannelConnector@localhost:0 14:32:45,962 INFO HBaseCommonTestingUtility:1143 - Minicluster is down 14:32:45,962 INFO HBaseTestingClusterAutostarter: 246 - HBase minicluster: Down Tests run: 5, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 24.443 sec <<< FAILURE! - in org.apache.flink.addons.hbase.HBaseConnectorITCase testTableSourceFullScan(org.apache.flink.addons.hbase.HBaseConnectorITCase) Time elapsed: 1.155 sec <<< ERROR! java.lang.NullPointerException at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceFullScan(HBaseConnectorITCase.java:168) testTableSourceFieldOrder(org.apache.flink.addons.hbase.HBaseConnectorITCase) Time elapsed: 0.016 sec <<< ERROR! java.lang.NullPointerException at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceFieldOrder(HBaseConnectorITCase.java:242) testTableSourceProjection(org.apache.flink.addons.hbase.HBaseConnectorITCase) Time elapsed: 0.013 sec <<< ERROR! java.lang.NullPointerException at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceProjection(HBaseConnectorITCase.java:207) testTableSourceReadAsByteArray(org.apache.flink.addons.hbase.HBaseConnectorITCase) Time elapsed: 0.04 sec <<< ERROR! java.lang.NullPointerException at org.apache.flink.addons.hbase.HBaseConnectorITCase.testTableSourceReadAsByteArray(HBaseConnectorITCase.java:279) 14:32:45,966 INFO log: 67 - Shutdown hook executing 14:32:45,966 INFO log: 67 - Shutdown hook complete 14:32:45,967 INFO ShutdownHook: 111 - Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@d6e7bab 14:32:45,967 INFO ShutdownHook: 120 - Starting fs shutdown hook thread. 14:32:45,968 INFO ShutdownHook: 134 - Shutdown hook finished. 14:32:46,000 INFO SessionTrackerImpl: 162 - SessionTrackerImpl exited loop! 14:32:46,862 INFO ClientCnxn:1032 - Opening socket connection to server localhost/127.0.0.1:54877. Will not attempt to authenticate using SASL (unknown error) 14:32:46,863 WARN ClientCnxn:1162 - Session 0x15dd6dc3bf80008 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) Results : Tests in error: HBaseConnectorITCase.testTableSourceFieldOrder:242 » NullPointer HBaseConnectorITCase.testTableSourceFullScan:168 » NullPointer HBaseConnectorITCase.testTableSourceProjection:207 » NullPointer HBaseConnectorITCase.testTableSourceReadAsByteArray:279 » NullPointer Tests run: 5, Failures: 0, Errors: 4, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] force-shading ...................................... SUCCESS [ 3.300 s] [INFO] flink .............................................. SUCCESS [ 8.989 s] [INFO] flink-annotations .................................. SUCCESS [ 3.240 s] [INFO] flink-shaded-hadoop ................................ SUCCESS [ 0.473 s] [INFO] flink-shaded-hadoop2 ............................... SUCCESS [ 8.268 s] [INFO] flink-shaded-hadoop2-uber .......................... SUCCESS [ 10.878 s] [INFO] flink-shaded-yarn-tests ............................ SUCCESS [ 9.590 s] [INFO] flink-shaded-curator ............................... SUCCESS [ 0.208 s] [INFO] flink-shaded-curator-recipes ....................... SUCCESS [ 1.957 s] [INFO] flink-shaded-curator-test .......................... SUCCESS [ 1.203 s] [INFO] flink-metrics ...................................... SUCCESS [ 0.195 s] [INFO] flink-metrics-core ................................. SUCCESS [ 2.823 s] [INFO] flink-test-utils-parent ............................ SUCCESS [ 0.219 s] [INFO] flink-test-utils-junit ............................. SUCCESS [ 1.106 s] [INFO] flink-core ......................................... SUCCESS [01:06 min] [INFO] flink-java ......................................... SUCCESS [ 25.683 s] [INFO] flink-runtime ...................................... SUCCESS [06:05 min] [INFO] flink-optimizer .................................... SUCCESS [ 16.387 s] [INFO] flink-clients ...................................... SUCCESS [ 8.251 s] [INFO] flink-streaming-java ............................... SUCCESS [ 44.170 s] [INFO] flink-test-utils ................................... SUCCESS [ 6.165 s] [INFO] flink-scala ........................................ SUCCESS [ 31.730 s] [INFO] flink-examples ..................................... SUCCESS [ 1.090 s] [INFO] flink-examples-batch ............................... SUCCESS [ 11.078 s] [INFO] flink-contrib ...................................... SUCCESS [ 0.198 s] [INFO] flink-statebackend-rocksdb ......................... SUCCESS [ 13.792 s] [INFO] flink-libraries .................................... SUCCESS [ 0.212 s] [INFO] flink-cep .......................................... SUCCESS [ 10.192 s] [INFO] flink-java8 ........................................ SUCCESS [ 10.480 s] [INFO] flink-runtime-web .................................. SUCCESS [ 12.007 s] [INFO] flink-connectors ................................... SUCCESS [ 0.208 s] [INFO] flink-hadoop-compatibility ......................... SUCCESS [ 10.877 s] [INFO] flink-avro ......................................... SUCCESS [ 9.403 s] [INFO] flink-tests ........................................ SUCCESS [07:51 min] [INFO] flink-streaming-scala .............................. SUCCESS [ 38.067 s] [INFO] flink-table ........................................ SUCCESS [03:02 min] [INFO] flink-jdbc ......................................... SUCCESS [ 3.811 s] [INFO] flink-hbase ........................................ FAILURE [ 29.184 s] [INFO] flink-hcatalog ..................................... SKIPPED [INFO] flink-metrics-jmx .................................. SKIPPED [INFO] flink-connector-kafka-base ......................... SKIPPED [INFO] flink-connector-kafka-0.8 .......................... SKIPPED [INFO] flink-connector-kafka-0.9 .......................... SKIPPED [INFO] flink-connector-kafka-0.10 ......................... SKIPPED [INFO] flink-connector-elasticsearch-base ................. SKIPPED [INFO] flink-connector-elasticsearch ...................... SKIPPED [INFO] flink-connector-elasticsearch2 ..................... SKIPPED [INFO] flink-connector-elasticsearch5 ..................... SKIPPED [INFO] flink-connector-rabbitmq ........................... SKIPPED [INFO] flink-connector-twitter ............................ SKIPPED [INFO] flink-connector-nifi ............................... SKIPPED [INFO] flink-connector-cassandra .......................... SKIPPED [INFO] flink-connector-filesystem ......................... SKIPPED [INFO] flink-examples-streaming ........................... SKIPPED [INFO] flink-examples-table ............................... SKIPPED [INFO] flink-gelly ........................................ SKIPPED [INFO] flink-gelly-scala .................................. SKIPPED [INFO] flink-gelly-examples ............................... SKIPPED [INFO] flink-python ....................................... SKIPPED [INFO] flink-ml ........................................... SKIPPED [INFO] flink-cep-scala .................................... SKIPPED [INFO] flink-scala-shell .................................. SKIPPED [INFO] flink-quickstart ................................... SKIPPED [INFO] flink-quickstart-java .............................. SKIPPED [INFO] flink-quickstart-scala ............................. SKIPPED [INFO] flink-storm ........................................ SKIPPED [INFO] flink-storm-examples ............................... SKIPPED [INFO] flink-streaming-contrib ............................ SKIPPED [INFO] flink-connector-wikiedits .......................... SKIPPED [INFO] flink-mesos ........................................ SKIPPED [INFO] flink-yarn ......................................... SKIPPED [INFO] flink-metrics-dropwizard ........................... SKIPPED [INFO] flink-metrics-ganglia .............................. SKIPPED [INFO] flink-metrics-graphite ............................. SKIPPED [INFO] flink-metrics-prometheus ........................... SKIPPED [INFO] flink-metrics-statsd ............................... SKIPPED [INFO] flink-metrics-datadog .............................. SKIPPED [INFO] flink-dist ......................................... SKIPPED [INFO] flink-yarn-tests ................................... SKIPPED [INFO] flink-fs-tests ..................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 23:48 min [INFO] Finished at: 2017-08-12T14:32:47Z [INFO] Final Memory: 211M/1468M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (integration-tests) on project flink-hbase_2.11: There are test failures. [ERROR] [ERROR] Please refer to /home/ec2-user/flink-upstream/flink-connectors/flink-hbase/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :flink-hbase_2.11 {noformat}",Major,Bug,FLINK,Flink,41,2,428266,28810,1,0,0,0.0,3.0,2017-08-12 17:30:57,2017-11-08 14:17:28 Minor fixes in full dev kerberos setup instructions,There is at least one error in metron-deployment/vagrant/Kerberos-setup.md and some other very minor changes for clarity/accuracy.,Major,Bug,METRON,Retired,51,8,130,16,1,0,1,0.0,2.0,2017-04-04 22:04:08,2017-04-20 03:36:06 spark on yarn-alpha with mvn on master branch won't build,"I try to build off master branch using maven to build yarn-alpha but get the following errors. mvn -Dyarn.version=0.23.10 -Dhadoop.version=0.23.10 -Pyarn-alpha clean package -DskipTests ----- [ERROR] /home/tgraves/y-spark-git/tools/src/main/scala/org/apache/spark/tools/GenerateMIMAIgnore.scala:25: object runtime i s not a member of package reflect [ERROR] import scala.reflect.runtime.universe.runtimeMirror [ERROR] ^ [ERROR] /home/tgraves/y-spark-git/tools/src/main/scala/org/apache/spark/tools/GenerateMIMAIgnore.scala:40: not found: value runtimeMirror [ERROR] private val mirror = runtimeMirror(classLoader) [ERROR] ^ [ERROR] /home/tgraves/y-spark-git/tools/src/main/scala/org/apache/spark/tools/GenerateMIMAIgnore.scala:92: object tools is not a member of package scala [ERROR] scala.tools.nsc.io.File("".mima-excludes""). [ERROR] ^ [ERROR] three errors found",Blocker,Bug,SPARK,Unknown,57,10,864,75,1,0,1,0.0,2.0,2014-03-25 08:10:02,2014-03-26 19:35:12 Bug with GString property access,"The following script produces a java.lang.ClassCastException: org.codehaus.groovy.runtime.GStringImpl with 1.5.2. With 1.5.0 it has printed 'peter' {code} class Person { String name } Person person = new Person() String propertyName = 'name' person.""$propertyName"" = 'peter' println person.name {code}",Major,Bug,GROOVY,Groovy,32,5,301,37,1,0,1,0.0,0.0,2008-01-30 07:09:54,2008-01-30 09:28:46 dependency:analyze shows errors,[INFO] Used undeclared dependencies: [INFO] org.codehaus.plexus:plexus-utils:jar:1.0.4:compile [INFO] org.codehaus.plexus:plexus-container-default:jar:1.0-alpha-8:compile [INFO] doxia:doxia-core:jar:1.0-alpha-4:compile [INFO] org.apache.maven:maven-plugin-descriptor:jar:2.0.5:compile [INFO] org.apache.maven.reporting:maven-reporting-api:jar:2.0:compile [INFO] org.apache.maven:maven-artifact:jar:2.0:compile [INFO] doxia:doxia-sink-api:jar:1.0-alpha-4:compile [INFO] Unused declared dependencies: [INFO] org.apache.maven:maven-plugin-tools-beanshell:jar:2.1:runtime [INFO] org.apache.maven:maven-plugin-tools-java:jar:2.1:runtime,Major,Bug,MPLUGIN,Maven,31,3,631,26,1,0,1,0.0,0.0,2007-03-24 08:59:44,2007-03-24 09:12:41 Improve fault tolerance when reading an online schema from a connection,"Using OpenDS 2.2 (latest version at this time), the Schema Editor cannot successfully load the online schema from the connection because of a badly formatted attribute type description returned by OpenDS. This is clearly a bug on OpenDS's side and a JIRA has been opened to address this issue OPENDS-4616 [http://java.net/jira/browse/OPENDS-4616]. Instead of failing badly, Studio should discard this particular attribute type and move to the next one. This would leave the project in a better state, rather than having strictly nothing after the import. Here's the full console report: ============================================================ Error reading schema: attributeTypes = ( 2.16.840.1.113730.3.1.35 NAME 'changelog' DESC 'the distinguished name of the entry which contains the set of entries comprising this server's changelog' EQUALITY distinguishedNameMatch SYNTAX 1.3.6.1.4.1.1466.115.121.1.12 SINGLE-VALUE NO-USER-MODIFICATION USAGE directoryOperation X-ORIGIN 'draft-good-ldap-changelog' ) ERR_04229 Parser failure on attribute type description: ( 2.16.840.1.113730.3.1.35 NAME 'changelog' DESC 'the distinguished name of the entry which contains the set of entries comprising this server's changelog' EQUALITY distinguishedNameMatch SYNTAX 1.3.6.1.4.1.1466.115.121.1.12 SINGLE-VALUE NO-USER-MODIFICATION USAGE directoryOperation X-ORIGIN 'draft-good-ldap-changelog' ) Antlr message: unexpected char: 's' !ENTRY org.apache.directory.studio.common.core 4 4 2011-12-06 17:07:14.767 !MESSAGE null - ERR_04229 Parser failure on attribute type description !SUBENTRY 1 org.apache.directory.studio.common.core 4 4 2011-12-06 17:07:14.767 !MESSAGE java.text.ParseException: ERR_04229 Parser failure on attribute type description: ( 2.16.840.1.113730.3.1.35 NAME 'changelog' DESC 'the distinguished name of the entry which contains the set of entries comprising this server's changelog' EQUALITY distinguishedNameMatch SYNTAX 1.3.6.1.4.1.1466.115.121.1.12 SINGLE-VALUE NO-USER-MODIFICATION USAGE directoryOperation X-ORIGIN 'draft-good-ldap-changelog' ) Antlr message: unexpected char: 's' at org.apache.directory.shared.ldap.model.schema.parsers.AttributeTypeDescriptionSchemaParser.parseAttributeTypeDescription(AttributeTypeDescriptionSchemaParser.java:119) at org.apache.directory.studio.schemaeditor.model.io.GenericSchemaConnector.getSchema(GenericSchemaConnector.java:197) at org.apache.directory.studio.schemaeditor.model.io.GenericSchemaConnector.importSchema(GenericSchemaConnector.java:97) at org.apache.directory.studio.schemaeditor.model.Project.fetchOnlineSchema(Project.java:249) at org.apache.directory.studio.schemaeditor.view.wizards.NewProjectWizard$1.run(NewProjectWizard.java:142) at org.apache.directory.studio.connection.ui.RunnableContextRunner$1.run(RunnableContextRunner.java:123) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) !STACK 0 java.text.ParseException: ERR_04229 Parser failure on attribute type description: ( 2.16.840.1.113730.3.1.35 NAME 'changelog' DESC 'the distinguished name of the entry which contains the set of entries comprising this server's changelog' EQUALITY distinguishedNameMatch SYNTAX 1.3.6.1.4.1.1466.115.121.1.12 SINGLE-VALUE NO-USER-MODIFICATION USAGE directoryOperation X-ORIGIN 'draft-good-ldap-changelog' ) Antlr message: unexpected char: 's' at org.apache.directory.shared.ldap.model.schema.parsers.AttributeTypeDescriptionSchemaParser.parseAttributeTypeDescription(AttributeTypeDescriptionSchemaParser.java:119) at org.apache.directory.studio.schemaeditor.model.io.GenericSchemaConnector.getSchema(GenericSchemaConnector.java:197) at org.apache.directory.studio.schemaeditor.model.io.GenericSchemaConnector.importSchema(GenericSchemaConnector.java:97) at org.apache.directory.studio.schemaeditor.model.Project.fetchOnlineSchema(Project.java:249) at org.apache.directory.studio.schemaeditor.view.wizards.NewProjectWizard$1.run(NewProjectWizard.java:142) at org.apache.directory.studio.connection.ui.RunnableContextRunner$1.run(RunnableContextRunner.java:123) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) ============================================================",Blocker,Improvement,DIRSTUDIO,Directory,71,11,4225,317,1,0,1,0.0,0.0,2011-12-06 17:59:11,2012-01-09 13:37:01 servicemix common component should be moved before deployable as servicemix-lwcontainer need it. (this was fixed in 3.2 but not on trunk),In root POM file order of deployables and common modules should be reversed otherwise with clean repository build and test of lwcontainer may fail. deployables depends on servicemix-shared which inturn depends on servicemix-common.,Major,Bug,SM,ServiceMix,137,21,231,33,1,0,1,0.0,0.0,2008-12-01 23:58:06,2008-12-10 19:59:09 IMAPMessageReader should call disconnect when closing instead of close,close is in fact an IMAP command that is used to expunge some mails. It keeps the connection open.,Major,New Feature,JAMES,James,70,9,98,19,1,0,0,0.0,1.0,2019-05-28 17:54:10,2019-05-29 10:52:48 create a login log,Create a table to log attempted logins,Minor,New Feature,VCL,Incubator,18,4,38,7,1,0,0,0.0,0.0,2010-01-20 22:19:43,2010-04-14 21:21:03 Refactor table store compactor,"There is currently some room for code optimization on the path of the compact. * It uses the CompactManager, which actually only uses the CompactTask. * It also doesn't use an asynchronous thread to complete the compaction. * There should be FileStoreTable to provide unified table-level compaction.",Major,Improvement,FLINK,Flink,30,4,299,47,1,1,1,0.0,1.0,2022-06-16 13:46:46,2022-06-17 08:36:30 inappbrowser on firefoxos uses deprecated commandproxy,"This line https://github.com/apache/cordova-plugin-inappbrowser/blob/master/src/firefoxos/InAppBrowserProxy.js#L191 requires 'cordova/exec/proxy' which leads to a warning in the console log: ""Please require 'cordova/exec/proxy' instead. The file firefoxos/InAppBrowserProxy.js should be changed to get rid of the warning.",Major,Improvement,CB,Cordova,54,6,321,30,1,1,0,0.0,1.0,2014-12-18 14:51:15,2014-12-18 14:56:14 Big CXF Bundles have truncated Export-Package instruction,"I should've investigated it for 2.7.8 but the issue got out of our attention, creating a dedicated JIRA to keep it tracked. Not a critical-level issue as CXF individual modules are proper bundles",Major,Bug,CXF,CXF,57,7,195,33,1,0,1,0.0,2.0,2013-11-21 13:40:02,2013-12-17 16:43:22 Null Value for Attribute_value in UIInput can have two different meanings,"1. no value is set to this component 2. An submitted value is empty (""""). In both cases the getValue() Method will result the valueBinding Problem: If any validation error occurs on the page, the submitted empty value will be replaced by the valueBinding and can be <> """" Any workarounds ?? regards, Andreas ----- I will close the ticket MYFACES-1056: It's the same background -------",Major,Bug,MYFACES,MyFaces,73,11,384,66,1,0,0,0.0,1.0,2006-03-03 00:05:28,2015-08-28 18:26:34 UnresolvedTableOrView should retain SQL text position,"UnresolvedTableOrView should retain SQL text position. The following commands will be handled: ""DROP TABLE unknown"" ""DESCRIBE TABLE unknown"" ""ANALYZE TABLE unknown COMPUTE STATISTICS"" ""ANALYZE TABLE unknown COMPUTE STATISTICS FOR COLUMNS col"" ""ANALYZE TABLE unknown COMPUTE STATISTICS FOR ALL COLUMNS"" ""SHOW CREATE TABLE unknown"" ""REFRESH TABLE unknown"" ""SHOW COLUMNS FROM unknown"" ""SHOW COLUMNS FROM unknown IN db"" ""ALTER TABLE unknown RENAME TO t"" ""ALTER VIEW unknown RENAME TO v""",Major,Sub-task,SPARK,Unknown,53,6,482,68,1,0,1,0.0,2.0,2021-01-09 18:52:59,2021-01-11 05:29:03 Unused variable in ActiveMQServerImpl.java,The {{journalInfo}} variable declared on [line 3518|https://github.com/apache/activemq-artemis/blob/main/artemis-server/src/main/java/org/apache/activemq/artemis/core/server/impl/ActiveMQServerImpl.java] is not used anywhere.,Trivial,Bug,ARTEMIS,ActiveMQ,42,4,225,11,1,0,1,0.0,1.0,2024-06-07 11:53:37,2024-06-19 19:56:56 Make RDF primitives Serializable,"I always use Jena when I handle RDF data with Apache Spark. However, when I want to store resulting RDD data (ex. RDD[Triple]) in binary format, I can't call RDD.saveAsObjectFile method. It's because RDD.saveAsObjectFile requires java.io.Serializable interface. See the following code. https://github.com/apache/spark/blob/v1.6.0/core/src/main/scala/org/apache/spark/rdd/RDD.scala#L1469 https://github.com/apache/spark/blob/v1.6.0/core/src/main/scala/org/apache/spark/util/Utils.scala#L79-L86 You can see that 1) RDD.saveAsObjectFile calls Util.serialize method 2) Util.serialize method requires the RDD-wrapped object implementing java.io.Serializable interface. For example, if you want to save a RDD[Triple] object, Triple must implements java.io.Serializable. So why not implement java.io.Serializable ? I think it will improve the usability in Apache Spark.",Major,Improvement,JENA,Jena,32,4,862,92,1,0,1,0.0,7.0,2016-09-08 16:32:26,2016-11-13 11:47:29 fcsh doesn't realize an embedded css has been updated,"Steps to reproduce: 1. Start a fcsh session 2. Compile using -defaults-css-files 3. Update external css 4. Recompile Actual Results: fcsh doesn't realize the css has been updated. It displays: ""Nothing has changed since the last compile. Skip..."" Expected Results: Recompile the swf because the css has changed . Workaround (if any): Do a dummie update in any of the as or mxml files to trigger a fresh compilation. Thanks!",Trivial,Bug,FLEX,Flex,53,9,423,70,1,0,1,0.0,0.0,2009-02-23 04:16:49,2009-06-23 15:38:42 [Python] Mention boost-cpp directly in the conda meta.yaml for pyarrow,We seem to also link some boost symbols into pyarrow. This should guarantee through the new `run_exports` pinning mechanism that we only see installs of arrow-cpp and pyarrow with the same `boost-cpp` version. conda-forge PR: https://github.com/conda-forge/pyarrow-feedstock/pull/63,Major,Task,ARROW,Retired,70,10,282,36,1,1,1,0.0,4.0,2019-01-09 15:31:11,2019-01-10 11:46:43 TcpPortProvider Configuration is not propagated correctly to the Evaluators,"When configuring the {{TcpPortProvider}}, its configuration is not propagated to the Evaluators. Instead, the Evaluator opens ports in the default range.",Major,Bug,REEF,Retired,75,9,153,21,1,0,0,0.0,2.0,2015-09-17 00:56:09,2015-09-17 09:08:39 Do STCS in DTCS-windows,"To avoid constant recompaction of files in big ( > max threshold) DTCS windows, we should do STCS of those files. Patch here: https://github.com/krummas/cassandra/commits/marcuse/dtcs_stcs",Normal,Sub-task,CASSANDRA,Cassandra,23,4,188,24,1,1,1,0.0,11.0,2015-09-07 10:46:52,2015-10-28 09:12:24 Notifiers always register on all events,"When adding new Notifier and deselecting events, after saving you are registred for all events. Excample: When you only want to register for Failures and Error, you are always registered to all events including success and warning. This happens only on new registrations, Edit registration works correctly.",Minor,Bug,CONTINUUM,Continuum,39,6,306,47,1,0,0,1.0,1.0,2005-12-16 16:01:47,2007-03-12 12:58:03 CQL deletes (aka DELETE),"CQL specification and implementation for data removal. This corresponds to the following RPC methods: * remove() * batch_mutate() (deleting, not updating) * truncate() (?) My thoughts on the syntax are that it can probably closely mirror a subset of `SELECT': {code:SQL} DELETE (FROM)? [USING CONSISTENCY.] WHERE {code} Optionally, you could support a form that makes the `WHERE' clause optional, statements without the clause would be interpreted as a column family truncation.",Low,Sub-task,CASSANDRA,Cassandra,24,4,501,73,1,0,1,0.0,0.0,2010-11-04 15:43:52,2011-01-20 23:11:49 "spark failed with native memory exhausted , need immediate attention","Native memory allocation (mmap) failed to map 7158628352 bytes for committing reserved memory. # # There is insufficient memory for the Java Runtime Environment to continue. # Native memory allocation (mmap) failed to map 7158628352 bytes for committing reserved memory. # Possible reasons: # The system is out of physical RAM or swap space # In 32 bit mode, the process size limit was hit # Possible solutions: # Reduce memory load on the system # Increase physical memory or swap space # Check if swap backing store is full # Use 64 bit Java on a 64 bit OS # Decrease Java heap size (-Xmx/-Xms) # Decrease number of Java threads # Decrease Java thread stack sizes (-Xss) # Set larger code cache with -XX:ReservedCodeCacheSize= # This output file may be truncated or incomplete.",Major,Bug,SPARK,Unknown,68,10,779,135,1,0,0,0.0,1.0,2017-07-25 13:37:30,2017-07-25 13:42:42 Double click mode: editing an action causes it to be flagged as changed,"When the ""Use double-click option on canvas"" is enabled we experience an incorrect behavior any time we make any change to any of the workflow's actions. As soon as we open any of the workflows' actions, the workflow is immediately marked as changed (workflow's tab name formatted in bold chars and save button enabled in the toolbar) and remains in that state even if we don't apply any change to any action in the workflow.",Major,Bug,HOP,Retired,71,13,425,75,1,0,1,0.0,1.0,2021-09-15 10:59:18,2021-09-15 15:38:50 Remove direct dependency of Numpy from Histogram,,Major,Sub-task,SPARK,Unknown,48,7,0,0,0,1,1,0.0,1.0,2024-10-31 12:50:27,2024-10-31 20:49:08 accuracy result in naive-bayes should be a scalar,"Naiver-bayes export accuracy string as result: acc_str = ""Training Accuracy (%): "" + acc print(acc_str) write(acc_str, $accuracy) same for Naiver-bayes-predict acc_str = ""Accuracy (%): "" + acc print(acc_str) if(cmdLine_accuracy != "" "") write(acc_str, cmdLine_accuracy) I thought maybe it's issues here.",Minor,Bug,SYSTEMDS,SystemDS,49,8,302,40,1,0,1,0.0,2.0,2016-04-22 09:41:55,2016-04-23 00:59:06 Implement a procedure to convert RS from S to DA,,Major,Sub-task,HBASE,Hadoop,48,10,0,0,0,1,1,0.0,4.0,2017-10-24 10:42:20,2018-04-10 12:01:29 Eclipse .classpath invalid for local libraries,See email thread http://mail-archives.apache.org/mod_mbox/buildr-users/200909.mbox/%3CE83D37A2-3E51-4084-9FB5-078D9C24DC6E@gmail.com%3E,Minor,Bug,BUILDR,Retired,46,6,135,4,1,0,1,0.0,0.0,2009-09-15 00:21:04,2009-09-15 00:23:00 JavaScript GLV: Use heartbeat to prevent connection timeout,We should implement a client ping that prevents connection timeout when possible.,Major,Improvement,TINKERPOP,Unknown,59,8,81,12,1,0,0,0.0,2.0,2018-02-14 15:33:00,2018-12-24 11:53:56 Files created by redundant tasks that have been killed are taken into consideration,"Hadoop starts redundant tasks (mappers, by default) if it some particular mappers are taking too long to be executed. When one of the redundant tasks finishes, the others are killed. Killed tasks may generate output files (usually empty) and Hive is considering them as part of the job output. In my case, I'm profiling one of the mappers in an INSERT OVERWRITE TABLE ... SELECT (map-only) query, and the extra time added by the profiler makes hadoop start a second mapper for the same part of the input. When one of these redundant mappers finishes, the other is killed, and /tmp/hive-xxxx/xxxxxxxxx.10000.insclause-0/ will have the following files: _tmp.attempt_XX....XX_XXXX_m_000000_0 attempt_XX....XX_XXXX_m_000000_0 attempt_XX....XX_XXXX_m_000000_1 attempt_XX....XX_XXXX_m_000000_2 ... The first file is empty, but Hive considers it as part of the generated output and tries to load it in the destination table, giving the following error message: Loading data to table output_table partition {p=p1} Failed with exception Cannot load text files into a table stored as SequenceFile. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask I'm not sure if the files generated by killed tasks will always be empty. If not, this bug might render the data inconsistent.",Minor,Bug,HIVE,Hadoop,83,13,1298,191,1,0,0,0.0,1.0,2009-02-06 11:06:38,2009-02-07 01:22:43 Experiments and notebooks are still alive after submarine is deleted,"After the submarine is down, we can find that the experiment and notebook pods are still alive in the cluster. Reproduce steps: # create submarine # access to the workbench by port forwarding # add notebook or experiment from the workbench # delete submarine # we can find out that notebooks, tfjobs, pytorchjobs and relating components are still alive. To fix the bug, we can maybe add onwerReferences to the created resources. Reference: * ownerReference: *[https://kubernetes.io/docs/concepts/overview/working-with-objects/owners-dependents/]*",Major,Bug,SUBMARINE,Retired,68,10,546,76,1,1,1,0.0,1.0,2021-07-30 09:21:44,2021-08-18 07:22:17 camel-parent - Cleanup cruft and some dependencies that are only used internally for testing,"We have to much junk and stuff in parent/pom.xml for 3rd party dependencies. Some are only util dependencies used in a few components for some special testing etc. parent is not a dumping place. Some dependencies like jackson, netty, loggers, and the likes are good to have.",Minor,Dependency upgrade,CAMEL,Camel,92,14,274,47,1,0,0,0.0,1.0,2023-10-20 13:58:43,2024-06-16 09:57:29 Could not decompress data. Buffer length is too small.,tez 使用snappy压缩方式时,会报错缓冲区太小: java.io.IOException: java.lang.InternalError: Could not decompress data. Buffer length is too small.java.io.IOException: java.lang.InternalError: Could not decompress data. Buffer length is too small. at org.apache.tez.runtime.library.common.shuffle.ShuffleUtils.shuffleToMemory(ShuffleUtils.java:137) at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.copyMapOutput(FetcherOrderedGrouped.java:550) at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.copyFromHost(FetcherOrderedGrouped.java:283) at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.fetchNext(FetcherOrderedGrouped.java:182) at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:194) at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:57) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:111) at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:58) at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:75) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Caused by: java.lang.InternalError: Could not decompress data. Buffer length is too small. at org.apache.hadoop.io.compress.snappy.SnappyDecompressor.decompressBytesDirect(Native Method) at org.apache.hadoop.io.compress.snappy.SnappyDecompressor.decompress(SnappyDecompressor.java:238) at org.apache.hadoop.io.compress.BlockDecompressorStream.decompress(BlockDecompressorStream.java:88) at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:105) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:210) at org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.readToMemory(IFile.java:833) at org.apache.tez.runtime.library.common.shuffle.ShuffleUtils.shuffleToMemory(ShuffleUtils.java:121) ... 12 more,Major,Bug,TEZ,Tez,54,9,2340,78,1,0,1,0.0,6.0,2021-02-20 09:07:44,2021-06-25 12:02:37 [DataFusion] Split expressions.rs,It is now 3k LOC that are largely independent.,Major,Improvement,ARROW,Retired,33,3,46,9,1,1,1,0.0,2.0,2021-01-25 05:21:36,2021-01-30 07:20:02 Add task_%STATUS%_%JOB% stat,"It would be helpful to keep counters of certain job task statuses. Currently, we only expose {{task_store_%STATUS%}} and {{task_store_rack}} stats. Having a bit more visibility into certain terminal states (e.g. LOST, FAILED) would ease up troubleshooting by job owners and platform operators.",Major,Task,AURORA,Aurora,28,3,293,42,1,1,1,0.0,2.0,2014-09-04 21:52:19,2014-09-06 00:18:09 aggregating plugins in submodules of the reactor return all projects causing a chicken/egg issue,"eg, assembly:attached when this is put in maven-core, and a build is run from the root project with a clean repo, it fails, as the original project sorter doesn't consider the dependencies, building plugin-tools after maven-core. However, hitting the aggregator when building maven-core then tries to resolve all of the projects as dependencies.",Major,Bug,MNG,Maven,96,14,345,53,1,0,1,13.0,14.0,2006-05-05 12:40:26,2007-10-28 21:28:31 [AMQP 1.0 JMS Client] Decoding destinations with no attributes can lead to NullPointerException,"Decoding destinations with no attributes can lead to NullPointerException {code}Exception in thread ""Thread-5"" java.lang.NullPointerException at org.apache.qpid.amqp_1_0.jms.impl.MessageImpl.join(MessageImpl.java:1341) at org.apache.qpid.amqp_1_0.jms.impl.MessageImpl.setJMSDestination(MessageImpl.java:231) at org.apache.activemq.transport.amqp.JmsClientRequestResponseTest.onMessage(JmsClientRequestResponseTest.java:226) at org.apache.qpid.amqp_1_0.jms.impl.SessionImpl$Dispatcher.run(SessionImpl.java:910) at java.lang.Thread.run(Thread.java:722){code} This can happen when using replyTo destination from the broker that didn't set attributes. We need to add extra check if attributes exists.",Major,Bug,QPID,Qpid,95,13,696,47,1,0,1,1.0,4.0,2014-05-29 16:01:34,2014-06-24 15:35:49 TestPriorityQueue failures,"Elastic CI found a couple of failures in TestPriorityQueue: {code} java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([7116E1C3DFA51E99:7507110B3E9E9A3]:0) at org.apache.lucene.util.TestPriorityQueue$IntegerQueue.lessThan(TestPriorityQueue.java:36) at org.apache.lucene.util.TestPriorityQueue$IntegerQueue.lessThan(TestPriorityQueue.java:28) at org.apache.lucene.util.PriorityQueue.upHeap(PriorityQueue.java:264) at org.apache.lucene.util.PriorityQueue.add(PriorityQueue.java:141) at org.apache.lucene.util.TestPriorityQueue.testIteratorRandom(TestPriorityQueue.java:241) {code} It can be reproduced with the following seed: -Dtests.seed=7116E1C3DFA51E99 It is due to https://issues.apache.org/jira/browse/LUCENE-8345 which removed the deprecated call to ""new Integer"" despite the fact that the queue in the tests (IntegerQueue#lessThan) does not allow to reuse Integers.",Major,Test,LUCENE,Lucene,26,2,882,62,1,0,0,0.0,3.0,2018-07-16 14:08:55,2018-07-20 10:16:39 Provider rule of consumer can not be removed,,Major,Bug,SCB,Incubator,44,8,0,0,0,0,1,0.0,2.0,2018-08-20 16:21:10,2018-08-20 16:50:57 Failed to recreate the table which has bloomfilter on it with same table name but different bloom index,"Steps to reproduce: ``` create table xu_t11(id int,name string,sal float) stored by 'carbondata' tblproperties('sort_columns'='id') create datamap xu_dm_t1_new1 on table xu_t11 using 'bloomfilter' dmproperties('index_columns'='id') insert into xu_t11 select 1,'m',122.33 // id.bloomindex is generated drop table if exists xu_t11 // recreate table with same datamap but with different index column create table xu_t11(id int,name string,sal float) stored by 'carbondata' tblproperties('sort_columns'='id') create datamap xu_dm_t1_new1 on table xu_t11 using 'bloomfilter' dmproperties('index_columns'='sal') insert into xu_t11 select 1,'m',122.33 // Expecte sal.bloomindex to be generated, but actually id.bloomindex is generated. ``` This will not be reproduced in testcase, can only be generated in cluster (with multiple executors).",Major,Sub-task,CARBONDATA,CarbonData,103,18,833,100,1,0,1,0.0,0.0,2018-07-11 09:28:21,2018-07-13 12:15:13 LUB of Type and Type,"Follow up to GROOVY-10756. Blending wildcard and unresolved parameterized type is incomplete. Consider the following: {code:groovy} interface Handle { int getCount() } class HandleContainer { H handle } interface Input { HandleContainer getResult(key) } interface State { def HandleContainer getResult(key) } void test(Input input, State state) { def container = state.getResult('k') ?: input.getResult('k') // HERE: HandleContainer<# extends Handle> and HandleContainer Handle handle = container.handle Integer count = handle.count assert count == 1 } Handle h = {->1} def c = new HandleContainer(handle: h) test({k->c} as Input, {k->c} as State) {code}",Major,Bug,GROOVY,Groovy,62,9,730,99,1,0,1,0.0,1.0,2023-03-17 17:34:25,2023-03-17 17:45:02 "cqlsh shouldn't display ""null"" for empty values","For historical reason (and compatibility with thrift), all type support an empty value, even type like int for which it doesn't really make sense (see CASSANDRA-5674 too on that subject). If you input such an empty value for a type like int, cqlsh will display it as null: {noformat} cqlsh:ks> CREATE TABLE test (k text PRIMARY KEY, v int); cqlsh:ks> INSERT INTO test(k, v) VALUES ('someKey', blobAsInt(0x)); cqlsh:ks> SELECT * FROM test; k | v ---------+------ someKey | null {noformat} But that's not correct, it suggests {{v}} has no value but that's not true, it has a value, it's just an empty one. Now, one may argue support empty values for a type like int is broken, and I would agree with that. But thrift allows it so we probably need to preserve that behavior for compatibility sake. And I guess the need to use blobAsInt at least make it clear that it's kind of a hack. That being said, cqlsh should not display null as this is confusing. Instead I'd suggest either displaying nothing (that's how an empty string is displayed after all), or to just go with some random explicit syntax like say ""[empty value]""",Low,Bug,CASSANDRA,Cassandra,47,7,1121,197,1,1,1,0.0,2.0,2013-06-20 12:36:18,2013-06-27 00:29:08 Docs for upgrade to 2.8.0 differ from template project (formatting),"When you generate a project with the ""create"" script, the linker flags include: {noformat} -force_load ${TARGET_BUILD_DIR}/libCordova.a {noformat} But according to the docs (http://cordova.apache.org/docs/en/2.9.0/guide_upgrading_ios_index.md.html#Upgrading%20Cordova%20iOS), you should add these flags (without the underscores): {noformat} -forceload ${TARGETBUILDDIR}/libCordova.a {noformat} Also, the flag you're replacing is ""-all_load"" in the template, and ""-allload"" in the docs.",Minor,Bug,CB,Cordova,67,10,485,50,1,0,1,0.0,3.0,2013-06-28 00:16:59,2013-06-28 00:41:33 Configurable impresonnation,"h3. What is impersonnation Hello I'm Bob, connect me as Alice. Use cases: - 1. Migration: migration user impersonnate existing user to migrate in/out emails of the user - 2. Assistance: An admin impersonate a user to assist them with one problem... - 3. Delegation: The secretary impersonnate her boss mails. h3. What exists today in James Impersonation exists for IMAP AUTHENTICATE PLAIN. Impersonation relies on the 'Authorizator' interface. A simple implementation of it is provided: We then verify this the user performing the impersonation is an admin account defined in the configuration. This makes it suitable for simple use cases defined in 1 and 2 (where multi-tenancy is not an issue) However, this is unsuitable for more advanced use cases. h3. Proposal Provide a configuration option to enable fine-grained authorization. If enabled, a storage API for delegation will be enabled (stores user X have the right to impersonate to user Y). We can then have a webadmin API to manage this, as well as the wiring needed in the AUthorizator.",Major,Improvement,JAMES,James,27,2,1046,171,1,0,0,0.0,1.0,2022-04-27 06:06:05,2022-06-03 10:43:18 "Disable EHCache ""phone home"" on startup","During startup EHCache does a check if the latest version is being used and sends more data than necessary. See http://martijndashorst.com/blog/2011/02/21/ehcache-and-quartz-phone-home-during-startup/ This can be disabled by changing ehcacheConfig.xml: into ",Trivial,Wish,SHINDIG,Shindig,39,6,493,36,1,0,0,0.0,0.0,2011-09-08 08:23:12,2011-09-08 08:46:00 authz plugin can no longer override conf file policy,"If enabled, the authz plugin should be allowed to defined the valid sources and targets for a given connection and this should take precedence over anything in the policy file (which may still be used for quotas). This was (I believe) an unintentional regression by https://github.com/apache/qpid-dispatch/commit/dc981ecc6cf31d8c605e84703a589553281281c2#diff-adc0a0fef2880417cb24cb072363fc29 which reverted the necessary change made in https://github.com/apache/qpid-dispatch/commit/eed8bb65497b23e512072f5ea9fefd8ed73921ef#diff-adc0a0fef2880417cb24cb072363fc29",Major,Bug,DISPATCH,Qpid,52,9,561,54,1,0,1,0.0,2.0,2018-10-18 23:30:59,2018-10-18 23:37:02 Add single argument support for to_timestamp in SQL,"Currently, it looks we can omit the timestamp format as below: {code} import org.apache.spark.sql.functions._ Seq(""2016-12-31 00:12:00.00"").toDF(""a"").select(to_timestamp(col(""a""))).show() {code} {code} +----------------------------------------+ |to_timestamp(`a`, 'yyyy-MM-dd HH:mm:ss')| +----------------------------------------+ | 2016-12-31 00:12:00| +----------------------------------------+ {code} whereas this does not work in SQL as below: {code} spark-sql> SELECT to_timestamp('2016-12-31 00:12:00.00'); Error in query: Invalid number of arguments for function to_timestamp; line 1 pos 7 {code} It looks we could support this too. For {{to_date}}, it looks already working in SQL as well as other language APIs. {code} scala> Seq(""2016-12-31"").toDF(""a"").select(to_date(col(""a""))).show() +----------+ |to_date(a)| +----------+ |2016-12-31| +----------+ {code} {code} spark-sql> SELECT to_date('2016-12-31'); 2016-12-31 {code}",Minor,Improvement,SPARK,Unknown,51,8,933,93,1,0,1,0.0,3.0,2017-05-08 19:12:22,2017-05-12 10:44:14 Make SessionProvider pluggable in JCRWebdavServerServlet,"Although there's a SessionProvider interface in o.a.j.server, the SessionProviderImpl implementation class is hard-coded into JCRWebdavServerServlet.",Major,Improvement,JCR,Jackrabbit,56,5,149,15,1,0,1,0.0,0.0,2010-09-01 15:28:36,2010-09-17 12:16:54 Create OSGi bundle for azure-messaging-eventhubs 5.6.0,,Major,Task,SM,ServiceMix,54,6,0,0,0,0,1,0.0,1.0,2021-03-25 10:32:44,2021-03-28 13:58:58 "Translate ""Improving the Website"" page into Chinese","Translate ""Improving the Website"" page into Chinese. The markdown file is located in: flink-web/improve-website.zh.md The url link is: https://flink.apache.org/zh/improve-website.html Please adjust the links in the page to Chinese pages when translating.",Major,Sub-task,FLINK,Flink,51,7,254,31,1,1,1,0.0,1.0,2019-02-08 17:12:20,2019-03-04 16:45:13 Right Hash Join with empty Left table ruturns 0 result,"Drill returns no results on the right Hash Join if the probe(left) table is empty. The simplest way to reproduce the issue: 1.To force Drill not to use merge join and use the hash join operator instead: {code:java} alter session set planner.enable_mergejoin = false; alter session set planner.enable_nestedloopjoin= false; {code} 2. Disable join order optimization to prevent Drill from flipping join tables: {code:java} alter session set planner.enable_join_optimization = false; {code} 3. Execute a query with empty left table outcome: {code:java} SELECT * FROM (SELECT * FROM (VALUES (1, 'Max', 28), (2, 'Jane', 32), (3, 'Saymon', 29) ) AS users(id, name, age) WHERE false ) AS users RIGHT JOIN (VALUES (1, 'Engineer'), (2, 'Doctor'), (3, 'Teacher') ) AS job(id, title) ON users.id = job.id {code} Expected result is: ||id||name||age||id0||title|| |null|null|null|1|Engineer| |null|null|null|2|Doctor| |null|null|null|3|Teacher| But we get 0 rows.",Major,Bug,DRILL,Drill,54,10,950,136,1,0,1,0.0,2.0,2024-10-14 14:25:12,2024-10-21 11:24:14 AbstractMethodError in bundlerepository due to wrong import range.,"Bundle org.apache.felix.bundlerepository imports package {{org.osgi.service.repository}} using the range {{[1.0,2.0)}}. This is incorrect because it is a provider of that contract, so the range should be {{[1.0,1.1)}}. At runtime this leads to AbstractMethodError because a client could wire to version 1.1 of the API and try to call one of the new methods such as {{Repository.newRequirementBuilder()}}, which is not implemented by Felix: {noformat} java.lang.AbstractMethodError: org.apache.felix.bundlerepository.impl.OSGiRepositoryImpl.newRequirementBuilder(Ljava/lang/String;)Lorg/osgi/service/repository/RequirementBuilder; {noformat} Affects version: 2.0.8 (not available in the JIRA dropdown for some reason).",Major,Bug,FELIX,Felix,66,8,717,77,1,0,1,0.0,2.0,2016-11-02 11:39:18,2016-11-16 15:15:27 Add a mock based test for ServiceTracker,As the test for ServiceTracker is similar to bundle tracker I also created it.,Major,Test,FELIX,Felix,40,7,78,14,1,0,1,0.0,2.0,2015-10-22 14:53:03,2015-12-09 14:52:25 Editorial Review,Editorial Review,Major,Improvement,AXIS2,Axis,16,2,16,2,1,0,0,0.0,0.0,2006-11-06 10:30:26,2006-11-07 07:18:54 "FormItem children overlap when specifying width, height and direction=""horizontal""","Steps to reproduce: Run the attached application, in which FormItem container specifies width, height and direction=""horizontal"". Actual Results: FormItem children overlap. (They don't line correctly.) Expected Results: FormItem children line horizontally. It works with SDK 2.0.1. Workaround: 1: Use HBox instead of direction=""horizontal"". 2: Specify direction='horizontal' only. (Don't specify width and height.)",Minor,Bug,FLEX,Flex,82,9,414,52,1,0,1,0.0,0.0,2009-01-16 01:41:52,2009-03-30 12:28:39 MVCC: invokeAll may hangs on unstable topology.,Test IgniteCacheEntryProcessorNodeJoinTest.testEntryProcessorNodeLeave() hangs with TRANSACTIONAL_SNAPSHOT cache mode.,Major,Bug,IGNITE,Ignite,47,7,118,7,1,1,1,0.0,2.0,2018-11-14 16:07:58,2019-01-11 15:03:28 field projection with namespace,"`AvroProjectionConverter` currently ignores extract namespace to identify fields to remove for a table. The change is to identify fields to remove with namespace into account, configurable.",Major,Task,GOBBLIN,Gobblin,31,4,189,26,1,0,1,0.0,1.0,2020-02-29 02:38:31,2020-03-02 18:34:02 nodetool repair -pr on all nodes won't repair the full range when a Keyspace isn't in all DC's,"nodetool repair -pr on all nodes won't repair the full range when a Keyspace isn't in all DC's Commands follow, but the TL;DR of it, range (127605887595351923798765477786913079296,0] doesn't get repaired between .38 node and .236 node until I run a repair, no -pr, on .38 It seems like primary arnge calculation doesn't take schema into account, but deciding who to ask for merkle tree's from does. {noformat} Address DC Rack Status State Load Owns Token 127605887595351923798765477786913079296 10.72.111.225 Cassandra rack1 Up Normal 455.87 KB 25.00% 0 10.2.29.38 Analytics rack1 Up Normal 40.74 MB 25.00% 42535295865117307932921825928971026432 10.46.113.236 Analytics rack1 Up Normal 20.65 MB 50.00% 127605887595351923798765477786913079296 create keyspace Keyspace1 with placement_strategy = 'NetworkTopologyStrategy' and strategy_options = {Analytics : 2} and durable_writes = true; ------- # nodetool -h 10.2.29.38 repair -pr Keyspace1 Standard1 [2013-04-03 15:46:58,000] Starting repair command #1, repairing 1 ranges for keyspace Keyspace1 [2013-04-03 15:47:00,881] Repair session b79b4850-9c75-11e2-0000-8b5bf6ebea9e for range (0,42535295865117307932921825928971026432] finished [2013-04-03 15:47:00,881] Repair command #1 finished root@ip-10-2-29-38:/home/ubuntu# grep b79b4850-9c75-11e2-0000-8b5bf6ebea9e /var/log/cassandra/system.log INFO [AntiEntropySessions:1] 2013-04-03 15:46:58,009 AntiEntropyService.java (line 676) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] new session: will sync a1/10.2.29.38, /10.46.113.236 on range (0,42535295865117307932921825928971026432] for Keyspace1.[Standard1] INFO [AntiEntropySessions:1] 2013-04-03 15:46:58,015 AntiEntropyService.java (line 881) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] requesting merkle trees for Standard1 (to [/10.46.113.236, a1/10.2.29.38]) INFO [AntiEntropyStage:1] 2013-04-03 15:47:00,202 AntiEntropyService.java (line 211) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] Received merkle tree for Standard1 from /10.46.113.236 INFO [AntiEntropyStage:1] 2013-04-03 15:47:00,697 AntiEntropyService.java (line 211) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] Received merkle tree for Standard1 from a1/10.2.29.38 INFO [AntiEntropyStage:1] 2013-04-03 15:47:00,879 AntiEntropyService.java (line 1015) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] Endpoints /10.46.113.236 and a1/10.2.29.38 are consistent for Standard1 INFO [AntiEntropyStage:1] 2013-04-03 15:47:00,880 AntiEntropyService.java (line 788) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] Standard1 is fully synced INFO [AntiEntropySessions:1] 2013-04-03 15:47:00,880 AntiEntropyService.java (line 722) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] session completed successfully root@ip-10-46-113-236:/home/ubuntu# grep b79b4850-9c75-11e2-0000-8b5bf6ebea9e /var/log/cassandra/system.log INFO [AntiEntropyStage:1] 2013-04-03 15:46:59,944 AntiEntropyService.java (line 244) [repair #b79b4850-9c75-11e2-0000-8b5bf6ebea9e] Sending completed merkle tree to /10.2.29.38 for (Keyspace1,Standard1) root@ip-10-72-111-225:/home/ubuntu# grep b79b4850-9c75-11e2-0000-8b5bf6ebea9e /var/log/cassandra/system.log root@ip-10-72-111-225:/home/ubuntu# ------- # nodetool -h 10.46.113.236 repair -pr Keyspace1 Standard1 [2013-04-03 15:48:00,274] Starting repair command #1, repairing 1 ranges for keyspace Keyspace1 [2013-04-03 15:48:02,032] Repair session dcb91540-9c75-11e2-0000-a839ee2ccbef for range (42535295865117307932921825928971026432,127605887595351923798765477786913079296] finished [2013-04-03 15:48:02,033] Repair command #1 finished root@ip-10-46-113-236:/home/ubuntu# grep dcb91540-9c75-11e2-0000-a839ee2ccbef /var/log/cassandra/system.log INFO [AntiEntropySessions:5] 2013-04-03 15:48:00,280 AntiEntropyService.java (line 676) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] new session: will sync a0/10.46.113.236, /10.2.29.38 on range (42535295865117307932921825928971026432,127605887595351923798765477786913079296] for Keyspace1.[Standard1] INFO [AntiEntropySessions:5] 2013-04-03 15:48:00,285 AntiEntropyService.java (line 881) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] requesting merkle trees for Standard1 (to [/10.2.29.38, a0/10.46.113.236]) INFO [AntiEntropyStage:1] 2013-04-03 15:48:01,710 AntiEntropyService.java (line 211) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] Received merkle tree for Standard1 from a0/10.46.113.236 INFO [AntiEntropyStage:1] 2013-04-03 15:48:01,943 AntiEntropyService.java (line 211) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] Received merkle tree for Standard1 from /10.2.29.38 INFO [AntiEntropyStage:1] 2013-04-03 15:48:02,031 AntiEntropyService.java (line 1015) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] Endpoints a0/10.46.113.236 and /10.2.29.38 are consistent for Standard1 INFO [AntiEntropyStage:1] 2013-04-03 15:48:02,032 AntiEntropyService.java (line 788) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] Standard1 is fully synced INFO [AntiEntropySessions:5] 2013-04-03 15:48:02,032 AntiEntropyService.java (line 722) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] session completed successfully root@ip-10-2-29-38:/home/ubuntu# grep dcb91540-9c75-11e2-0000-a839ee2ccbef /var/log/cassandra/system.log INFO [AntiEntropyStage:1] 2013-04-03 15:48:01,898 AntiEntropyService.java (line 244) [repair #dcb91540-9c75-11e2-0000-a839ee2ccbef] Sending completed merkle tree to /10.46.113.236 for (Keyspace1,Standard1) root@ip-10-72-111-225:/home/ubuntu# grep dcb91540-9c75-11e2-0000-a839ee2ccbef /var/log/cassandra/system.log root@ip-10-72-111-225:/home/ubuntu# ------- # nodetool -h 10.72.111.225 repair -pr Keyspace1 Standard1 [2013-04-03 15:48:30,417] Starting repair command #1, repairing 1 ranges for keyspace Keyspace1 [2013-04-03 15:48:30,428] Repair session eeb12670-9c75-11e2-0000-316d6fba2dbf for range (127605887595351923798765477786913079296,0] finished [2013-04-03 15:48:30,428] Repair command #1 finished root@ip-10-72-111-225:/home/ubuntu# grep eeb12670-9c75-11e2-0000-316d6fba2dbf /var/log/cassandra/system.log INFO [AntiEntropySessions:1] 2013-04-03 15:48:30,427 AntiEntropyService.java (line 676) [repair #eeb12670-9c75-11e2-0000-316d6fba2dbf] new session: will sync /10.72.111.225 on range (127605887595351923798765477786913079296,0] for Keyspace1.[Standard1] INFO [AntiEntropySessions:1] 2013-04-03 15:48:30,428 AntiEntropyService.java (line 681) [repair #eeb12670-9c75-11e2-0000-316d6fba2dbf] No neighbors to repair with on range (127605887595351923798765477786913079296,0]: session completed root@ip-10-46-113-236:/home/ubuntu# grep eeb12670-9c75-11e2-0000-316d6fba2dbf /var/log/cassandra/system.log root@ip-10-46-113-236:/home/ubuntu# root@ip-10-2-29-38:/home/ubuntu# grep eeb12670-9c75-11e2-0000-316d6fba2dbf /var/log/cassandra/system.log root@ip-10-2-29-38:/home/ubuntu# --- root@ip-10-2-29-38:/home/ubuntu# nodetool -h 10.2.29.38 repair Keyspace1 Standard1 [2013-04-03 16:13:28,674] Starting repair command #2, repairing 3 ranges for keyspace Keyspace1 [2013-04-03 16:13:31,786] Repair session 6bb81c20-9c79-11e2-0000-8b5bf6ebea9e for range (42535295865117307932921825928971026432,127605887595351923798765477786913079296] finished [2013-04-03 16:13:31,786] Repair session 6cb05ed0-9c79-11e2-0000-8b5bf6ebea9e for range (0,42535295865117307932921825928971026432] finished [2013-04-03 16:13:31,806] Repair session 6d24a470-9c79-11e2-0000-8b5bf6ebea9e for range (127605887595351923798765477786913079296,0] finished [2013-04-03 16:13:31,807] Repair command #2 finished root@ip-10-2-29-38:/home/ubuntu# grep 6d24a470-9c79-11e2-0000-8b5bf6ebea9e /var/log/cassandra/system.log INFO [AntiEntropySessions:7] 2013-04-03 16:13:31,065 AntiEntropyService.java (line 676) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] new session: will sync a1/10.2.29.38, /10.46.113.236 on range (127605887595351923798765477786913079296,0] for Keyspace1.[Standard1] INFO [AntiEntropySessions:7] 2013-04-03 16:13:31,065 AntiEntropyService.java (line 881) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] requesting merkle trees for Standard1 (to [/10.46.113.236, a1/10.2.29.38]) INFO [AntiEntropyStage:1] 2013-04-03 16:13:31,751 AntiEntropyService.java (line 211) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] Received merkle tree for Standard1 from /10.46.113.236 INFO [AntiEntropyStage:1] 2013-04-03 16:13:31,785 AntiEntropyService.java (line 211) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] Received merkle tree for Standard1 from a1/10.2.29.38 INFO [AntiEntropyStage:1] 2013-04-03 16:13:31,805 AntiEntropyService.java (line 1015) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] Endpoints /10.46.113.236 and a1/10.2.29.38 are consistent for Standard1 INFO [AntiEntropyStage:1] 2013-04-03 16:13:31,806 AntiEntropyService.java (line 788) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] Standard1 is fully synced INFO [AntiEntropySessions:7] 2013-04-03 16:13:31,806 AntiEntropyService.java (line 722) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] session completed successfully root@ip-10-46-113-236:/home/ubuntu# grep 6d24a470-9c79-11e2-0000-8b5bf6ebea9e /var/log/cassandra/system.log INFO [AntiEntropyStage:1] 2013-04-03 16:13:31,665 AntiEntropyService.java (line 244) [repair #6d24a470-9c79-11e2-0000-8b5bf6ebea9e] Sending completed merkle tree to /10.2.29.38 for (Keyspace1,Standard1) {noformat}",Urgent,Bug,CASSANDRA,Cassandra,94,18,9284,752,1,0,1,0.0,4.0,2013-04-03 18:58:15,2013-04-19 23:34:01 Incorrect sorting order for all unhealthy replicas in RatisOverReplicationHandler,"{code} if (allUnhealthy) { // prefer deleting replicas with lower sequence IDs return replicas.stream() .sorted(Comparator.comparingLong(ContainerReplica::getSequenceId) .reversed()) .collect(Collectors.toList()); } {code} This should actually be the opposite, allowing lower sequence IDs to be deleted first. Also need to consider what happens when two replicas have the same sequence ID - how are ties broken? Consistent ordering matters in case of SCM failover.",Major,Sub-task,HDDS,Ozone,81,9,464,60,1,1,1,0.0,1.0,2023-11-21 15:21:58,2023-11-30 08:30:03 Figure out and implement some kind of simple authentication mechanism,"We want to at least facilitate simple authentication and anonynous binds alike with a simple JAAS based solution. Let's look into using security manger base operations like doAs and doPrivledged to understand how to sandbox users as well. Plus there's the whole problem of how do we manage the logical user session? What's the associatation with new contexts and users - also how do we protect from impersonation. How do we set the admin password when starting for the first time. Do we just use the first principal and credentials given for the uid=admin,ou=system special super user account? These are all questions that need to be answered.",Major,New Feature,DIRSERVER,Directory,69,10,643,107,1,0,1,0.0,0.0,2004-10-28 07:07:12,2004-11-01 04:37:00 Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data,"The task is to investigate whether the field AbstractCSQueue#configuredNodeLabels holds the same data as QueueCapacities#getExistingNodeLabels. Obviously, we don't want double-entry bookkeeping so if the data is the same, we can remove this or that.",Minor,Sub-task,YARN,Hadoop,113,9,249,34,1,0,1,0.0,2.0,2021-08-30 00:18:25,2023-01-03 17:17:57 Add warning for Linux AIO build option,There are performance and size limits when building with Linux AIO. The proposal is to remove build options for LInux AIO until is becomes more stable.,Major,Improvement,TS,Traffic Server,38,7,151,26,1,1,1,0.0,2.0,2016-08-20 01:25:59,2016-09-07 20:07:49 Disable the Parquet format in DatasetSink,"Kite is changing the default Parquet appender to the non-durable version. The reasons are complicated, but it's probably safer to disable the Parquet format until that gets sorted out in Kite.",Major,Bug,FLUME,Flume,41,6,192,31,1,0,1,0.0,3.0,2014-10-08 00:52:13,2015-01-29 03:06:50 Get rid of commons-lang3,Currently commons-lang3 is only used on a few locations. That should be removed.,Minor,Improvement,MDEP,Maven,24,4,80,13,1,0,1,0.0,1.0,2023-11-05 18:31:09,2023-11-05 19:32:27 "Implement end-to-end tests for vectorized string and math functions, and casts","Vectorized implementations of string functions, math functions, and type casts have been implemented. Currently, these have junit tests to verify input/output correctness on batches of rows. They have been tested from the command line to verify end-to-end execution. However, we should add end-to-end tests to verify they work from SQL statements and produce the right results. This will catch regressions in case of, for example, incorrect changes in VectorizationContext.java.",Minor,Sub-task,HIVE,Hadoop,78,11,478,69,1,0,1,0.0,2.0,2013-10-11 01:51:57,2013-10-17 17:12:42 Query parsing runs slower when using ANTLR v4,"The system now uses ANTLR v3. When transformed to ANTLR v4 using previous grammar definition, experiment result shows that the efficiency of logical plan generation is negatively impacted.",Major,Improvement,IOTDB,Unknown,45,8,188,28,1,0,0,0.0,1.0,2019-09-06 07:29:16,2021-01-21 15:42:36 Artifacts verification,Verification of all artifacts created in RC build/ This needs to be done on Mac/Linux and Windows OS.,Major,Sub-task,SYSTEMDS,SystemDS,22,2,101,18,1,0,1,0.0,1.0,2017-01-17 19:32:11,2017-03-03 21:47:18 Dynamic reservations are not counted as used resources in the master,"Dynamically reserved resources should be considered used or allocated and hence reflected in Mesos bookkeeping structures and {{state.json}}. I expanded the {{ReservationTest.ReserveThenUnreserve}} test with the following section: {code} // Check that the Master counts the reservation as a used resource. { Future response = process::http::get(master.get(), ""state.json""); AWAIT_READY(response); Try parse = JSON::parse(response.get().body); ASSERT_SOME(parse); Result cpus = parse.get().find(""slaves[0].used_resources.cpus""); ASSERT_SOME_EQ(JSON::Number(1), cpus); } {code} and got {noformat} ../../../src/tests/reservation_tests.cpp:168: Failure Value of: (cpus).get() Actual: 0 Expected: JSON::Number(1) Which is: 1 {noformat} Idea for new resources states: https://docs.google.com/drawings/d/1aquVIqPY8D_MR-cQjZu-wz5nNn3cYP3jXqegUHl-Kzc/edit",Minor,Bug,MESOS,Mesos,68,11,927,82,1,1,0,0.0,8.0,2015-08-31 17:53:39,2018-12-03 23:15:55 ResourceStreamResource should use #getResourceStream() instead of directly using the 'stream' field,org.apache.wicket.request.resource.ResourceStreamResource#newResourceResponse() resolves the IResourceStream by using #internalGetResourceStream() but later still uses the 'stream' member field.,Major,Bug,WICKET,Wicket,99,11,194,15,1,0,1,0.0,1.0,2012-06-28 14:41:35,2012-06-28 14:49:00 StringDelimitedUnparser - contains code to pad/truncate,"The StringDelimitedUnparser is used both itself and as a base class of LiteralNilDelimitedEndOfDataUnparser. This unparser still contains logic for performing pad/truncate. This code will still execute, and won't cause errors all the time, because the new unparser mechanism for pad/fill will simply see a string that has already been padded, and so won't add any more. However, this code is redundant, and there is at least one known bug in it, which is DFDL-1325. This code should be removed so this code is not responsible for pad/fill, nor should it be checking that the length is not too long. nor should it be truncating. See also DFDL-1595 about where the length-too-long check needs to be now.",Major,Bug,DAFFODIL,Daffodil,55,6,701,116,1,0,1,0.0,2.0,2016-09-06 16:17:24,2016-09-15 00:57:25 DatabaseDescriptor.hasExistingNoSystemTables return true even with only system keyspace,"The hasExistingNoSystemTables method in DatabaseDescriptor checks for directory only. On a new start, system KS would be created. This method current return true because of it, resulting incorrect/confusing log: logger.info(""Found table data in data directories. Consider using the CLI to define your schema."") ;",Low,Bug,CASSANDRA,Cassandra,87,8,312,44,1,0,0,0.0,2.0,2013-02-26 06:43:32,2013-03-07 22:18:02