Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DFDL-1830

PCAP - 50m.pcap and 100m.pcap do not parse on 2.0.0-rc3

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocking
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: General
    • Labels:
      None
    • Environment:
      Performance test platform

      Description

      When attempting to run the pcap performance tests found that the 50m.pcap and 100m.pcap test files did not successfully parse. Executed the daffodil parse command separately for each file and got the following results.

      50m.pcap Command with -I null: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I null -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Message: [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. Command with -I xml: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Results: <pcap:PCAP xmlns:pcap="urn:pcap:2.4"> <PCAPHeader>    <MagicNumber>D4C3B2A1</MagicNumber>    <Version>      <Major>2</Major>      <Minor>4</Minor>    </Version>    <Zone>0</Zone>    <SigFigs>0</SigFigs>    <SnapLen>65535</SnapLen>    <Network>1</Network> </PCAPHeader> <Packet>    <PacketHeader>      <Seconds>1367244575</Seconds>      <USeconds>191642</USeconds>      <InclLen>1514</InclLen>      <OrigLen>1514</OrigLen>    </PacketHeader>    <pcap:LinkLayer>      <pcap:Ethernet>        <MACDest>3C4A92729886</MACDest>        <MACSrc>001B2134662C</MACSrc>        <Ethertype>2048</Ethertype>        <pcap:NetworkLayer>          <pcap:IPv4>            <IPv4Header>              <Version>4</Version>              <IHL>5</IHL>              <DSCP>0</DSCP>              <ECN>0</ECN>              <Length>1500</Length>              <Identification>36974</Identification>              <Flags>2</Flags>              <FragmentOffset>0</FragmentOffset>              <TTL>49</TTL>              <Protocol>6</Protocol>              <Checksum>20238</Checksum>              <IPSrc>146.137.96.7</IPSrc>              <IPDest>192.168.177.102</IPDest>            </IPv4Header>            <Protocol>6</Protocol>            <pcap:TransportLayer>              <pcap:TCP>                <TCPHeader>                   <PortSRC>80</PortSRC>                  <PortDest>37199</PortDest>                  <Seq>802941038</Seq>                  <Ack>71825065</Ack>                  <DataOffset>8</DataOffset>                  <Reserved>0</Reserved>                  <Flags>16</Flags>                  <WindowSize>54</WindowSize>                  <Checksum>40234</Checksum>                  <Urgent>0</Urgent>                  <Options>0101080A314391951321EA44</Options>                </TCPHeader>                <Data>68C263E237A3DB9073CC9809FF2E3DFFB1C5A686E28FCDA362C25F5615AF4E0D7DD623CF008103C51DF23C88CF155B66AC29B15D65F4BE96D075B441736CBB415B6C2787117ED7AB3F430C86E9177848E6B1070D18B3CDC48E7318E18FC961ECA4398897F076D21CCC4B583B316026B713139E8976129726E9A4F8501AD1666C716E2A06BF669B89DB22F110CC3643B6719D26985E2137EC436D71FB0C3FFD67E34CDC88980B39BC2D6EDCC0131F6FF8697C8A316F7CA6618741ED768107FB5C5BBCCC8BE25B50042FB49FB5C5779BDAF70A78EC5B6DF1C3467B8245B4637F6A4B4837B5978AF69156D47DA6F6ADB2BD1BF53DA676C917F64AB6448B613389696EEDBD025B625ED033719DAFC475065F898174D52E7594D8666ADF21F07F857539B1D79837718F681F85FD240E9ADA4745FBD13AC4648BD13E2D55B4630F6B9B966B6A97FC1E3B84BAD324B7168397692D6E415B249A4DEDD33AA4CC695DE836743DCD74C615B5BD8AFB94B01FC3A7A6ED33E11956B92F986044BB292E5952F8332F9B252D78BDB6A41973591097AAE282DE5912302521ED026745483BF7530B48569382E3159DFF84EC23E45EC0E21672F8761DEA2DFA5EC966D9A29FA9DA2C5BF5B37A9B65BB7E766AB374EB67AD36CB2EFDF99ACDB2573F17B259F64BFF2598F1C8F1DF3A874A98F8DF3C49FC6F0E8EFFD63C1107ACA0CD2A6CC6B6183E685D27DB7D280153BDCD04B3DD54DF69AAEFD1E1B14F37C6C6B61B30D1F1466C9F3A60C4F0980E2356C70C18312A66CCC0139D69F866ACB07F5B5E1AD998E1CBD3C6A45FF0186BE08F36F9754CBC116FAD03069EE86E51CFEFA475C4A039C66DB4C75498D6944E53AC5827FDB48DE283A1C7F81403267AC0A02DBA59C8E166F241295BEB41CAAF0C78EB2143BFD671E1CB36D8A86D4ED8F72E0063ACB3B65463AC4DC6071B60EC2DC27E6C6E2AFA3B6CC06BBCD7616B09DEC372F80E941DB2BE1345C628DB08B3253191EB26053FBFB625E5CAF6E0F75E6C494E4143928FF01A7E94D4663C1793E70FE2CC2147DF83D8945CC3D792DA8DBDA16D67D5C47375CEAFAD44DF7783564326495B0C79266D57C3C69324FB049CF24C3EA9CB38777A20DAD4AE86D290D4457C4E82674FD07991E9EC45D1E5603AF3B1251D32CE7CA6348B3839655BB0CCA76C0BA521660FC68E19BCB314813369CFE4E7184CFA0E2B43A908730ED0613A43C6BCAC2E320CC54CD61C1986E221DB6A7A7FCC784F0CF4847DB7CDDC6E633D91F1D39AC8FA0D9B678391E1696D65A3FA3B6690854143D750A88FD0B3B72ED339CF2379B23D45E8AB2A8CBEA6C787D53BC618744E4F0FAB53EB23A6F7301F6931CDDB2160A6DBA998F0AC8D7C1E4BF1707AD57FF7EC37F8CC647AE8FB0FC01DACEBE9B4A78B337D94972862FEF4EE49DA4DF9C6F441E3AC633AE5A8E1E04D6792776C0B8F7346BC71063223250CCD6B839E7DD86698F2901979466C9951A6187567643C94BBCE680EA24DCFA9667418FA9AB1DD84335E7FEF42E401E2BD0BDB8CAE2AED1DB3E0F65E714EC2C7EE8CAC774E4F5FD858A49DF7729DCED82BF8B5C28F66C8F3C61943CCFA9FE9665E8CF7A2FFD36E92ED90496E2332F662CF3863D40CAF2AAD534D769E20FC7AC678C8793EA761664A68FBCC4C2AC65C33EDC6BA36B3A42AECBA39B3C2583767AE5315FB045F9B095B9DD916AAD3193B0D799E680B3EFB9AB92D147EE64498AE88307CBD9BB927321ED2CBCC7D1161F8FA38F3A05C3B10C7668E8AFA2388C9C9CC9055B26AC82A392D7C8E91AC1AB24ACE318D2D348D2D9D646CA149CE6EBBBE3625AFFDDF79DE64E409C94E2DAF0E9673B2FBFF1A7E9EE325B7193E9BDC113E774AEE12F5E43E9441B116248F04E745C97DE1F3BD594CC6997494B562EC2C77F03A322BDD8845B34C795DF248C4E75C5CFEB3DA429FC189773EEDF2399D6157B3B69BEA3B4CF51EA3AEE3477DE17EF4F5EAEFC9DB66EDF9BF3717C970D63EFD79A86DD660C4F746F8D9C5AC8321F460DC049C63FA7B</Data>              </pcap:TCP>            </pcap:TransportLayer>          </pcap:IPv4>        </pcap:NetworkLayer>      </pcap:Ethernet>    </pcap:LinkLayer> </Packet> </pcap:PCAP> [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. 100m.pcap Command: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/100m.pcap Error message (same for -I null or -I xml): [error] Parse Error: Failed to populate Packet[1]. Expected 1 item(s). Cause: Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100. Schema context: Packet Location line 29 column 10 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 104858829 [error] Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100

        Gliffy Diagrams

          Attachments

            Activity

              People

              Assignee:
              dthompson David Thompson
              Reporter:
              dthompson David Thompson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Tasks