Jumbune
  1. Jumbune
  2. JUM-76

Data Validation job fails if there is a file that is not of the specified format

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 1.0.0, 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.3.0, 1.4.0
    • Fix Version/s: None
    • Component/s: data validation
    • Labels:
      None

      Description

      Jumbune's data validation MR job fails if there is a file of a different format or content on the validation path

      Error: java.lang.ArrayIndexOutOfBoundsException: 1
      at org.jumbune.datavalidation.DataValidationMapper.map(DataValidationMapper.java:98)
      at org.jumbune.datavalidation.DataValidationMapper.map(DataValidationMapper.java:28)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Sourav Karwa
            Reporter:
            Mahesh Nair
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated: