Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DFDL-1830

PCAP - 50m.pcap and 100m.pcap do not parse on 2.0.0-rc3

XMLWordPrintableJSON

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Blocking Blocking
    • 2.0.0
    • 2.0.0
    • General
    • None
    • Performance test platform

      When attempting to run the pcap performance tests found that the 50m.pcap and 100m.pcap test files did not successfully parse. Executed the daffodil parse command separately for each file and got the following results.

      50m.pcap Command with -I null: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I null -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Message: [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. Command with -I xml: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Results: <pcap:PCAP xmlns:pcap="urn:pcap:2.4"> <PCAPHeader>    <MagicNumber>D4C3B2A1</MagicNumber>    <Version>      <Major>2</Major>      <Minor>4</Minor>    </Version>    <Zone>0</Zone>    <SigFigs>0</SigFigs>    <SnapLen>65535</SnapLen>    <Network>1</Network> </PCAPHeader> <Packet>    <PacketHeader>      <Seconds>1367244575</Seconds>      <USeconds>191642</USeconds>      <InclLen>1514</InclLen>      <OrigLen>1514</OrigLen>    </PacketHeader>    <pcap:LinkLayer>      <pcap:Ethernet>        <MACDest>3C4A92729886</MACDest>        <MACSrc>001B2134662C</MACSrc>        <Ethertype>2048</Ethertype>        <pcap:NetworkLayer>          <pcap:IPv4>            <IPv4Header>              <Version>4</Version>              <IHL>5</IHL>              <DSCP>0</DSCP>              <ECN>0</ECN>              <Length>1500</Length>              <Identification>36974</Identification>              <Flags>2</Flags>              <FragmentOffset>0</FragmentOffset>              <TTL>49</TTL>              <Protocol>6</Protocol>              <Checksum>20238</Checksum>              <IPSrc>146.137.96.7</IPSrc>              <IPDest>192.168.177.102</IPDest>            </IPv4Header>            <Protocol>6</Protocol>            <pcap:TransportLayer>              <pcap:TCP>                <TCPHeader>                   <PortSRC>80</PortSRC>                  <PortDest>37199</PortDest>                  <Seq>802941038</Seq>                  <Ack>71825065</Ack>                  <DataOffset>8</DataOffset>                  <Reserved>0</Reserved>                  <Flags>16</Flags>                  <WindowSize>54</WindowSize>                  <Checksum>40234</Checksum>                  <Urgent>0</Urgent>                  <Options>0101080A314391951321EA44</Options>                </TCPHeader>                <Data>68C263E237A3DB9073CC9809FF2E3DFFB1C5A686E28FCDA362C25F5615AF4E0D7DD623CF008103C51DF23C88CF155B66AC29B15D65F4BE96D075B441736CBB415B6C2787117ED7AB3F430C86E9177848E6B1070D18B3CDC48E7318E18FC961ECA4398897F076D21CCC4B583B316026B713139E8976129726E9A4F8501AD1666C716E2A06BF669B89DB22F110CC3643B6719D26985E2137EC436D71FB0C3FFD67E34CDC88980B39BC2D6EDCC0131F6FF8697C8A316F7CA6618741ED768107FB5C5BBCCC8BE25B50042FB49FB5C5779BDAF70A78EC5B6DF1C3467B8245B4637F6A4B4837B5978AF69156D47DA6F6ADB2BD1BF53DA676C917F64AB6448B613389696EEDBD025B625ED033719DAFC475065F898174D52E7594D8666ADF21F07F857539B1D79837718F681F85FD240E9ADA4745FBD13AC4648BD13E2D55B4630F6B9B966B6A97FC1E3B84BAD324B7168397692D6E415B249A4DEDD33AA4CC695DE836743DCD74C615B5BD8AFB94B01FC3A7A6ED33E11956B92F986044BB292E5952F8332F9B252D78BDB6A41973591097AAE282DE5912302521ED026745483BF7530B48569382E3159DFF84EC23E45EC0E21672F8761DEA2DFA5EC966D9A29FA9DA2C5BF5B37A9B65BB7E766AB374EB67AD36CB2EFDF99ACDB2573F17B259F64BFF2598F1C8F1DF3A874A98F8DF3C49FC6F0E8EFFD63C1107ACA0CD2A6CC6B6183E685D27DB7D280153BDCD04B3DD54DF69AAEFD1E1B14F37C6C6B61B30D1F1466C9F3A60C4F0980E2356C70C18312A66CCC0139D69F866ACB07F5B5E1AD998E1CBD3C6A45FF0186BE08F36F9754CBC116FAD03069EE86E51CFEFA475C4A039C66DB4C75498D6944E53AC5827FDB48DE283A1C7F81403267AC0A02DBA59C8E166F241295BEB41CAAF0C78EB2143BFD671E1CB36D8A86D4ED8F72E0063ACB3B65463AC4DC6071B60EC2DC27E6C6E2AFA3B6CC06BBCD7616B09DEC372F80E941DB2BE1345C628DB08B3253191EB26053FBFB625E5CAF6E0F75E6C494E4143928FF01A7E94D4663C1793E70FE2CC2147DF83D8945CC3D792DA8DBDA16D67D5C47375CEAFAD44DF7783564326495B0C79266D57C3C69324FB049CF24C3EA9CB38777A20DAD4AE86D290D4457C4E82674FD07991E9EC45D1E5603AF3B1251D32CE7CA6348B3839655BB0CCA76C0BA521660FC68E19BCB314813369CFE4E7184CFA0E2B43A908730ED0613A43C6BCAC2E320CC54CD61C1986E221DB6A7A7FCC784F0CF4847DB7CDDC6E633D91F1D39AC8FA0D9B678391E1696D65A3FA3B6690854143D750A88FD0B3B72ED339CF2379B23D45E8AB2A8CBEA6C787D53BC618744E4F0FAB53EB23A6F7301F6931CDDB2160A6DBA998F0AC8D7C1E4BF1707AD57FF7EC37F8CC647AE8FB0FC01DACEBE9B4A78B337D94972862FEF4EE49DA4DF9C6F441E3AC633AE5A8E1E04D6792776C0B8F7346BC71063223250CCD6B839E7DD86698F2901979466C9951A6187567643C94BBCE680EA24DCFA9667418FA9AB1DD84335E7FEF42E401E2BD0BDB8CAE2AED1DB3E0F65E714EC2C7EE8CAC774E4F5FD858A49DF7729DCED82BF8B5C28F66C8F3C61943CCFA9FE9665E8CF7A2FFD36E92ED90496E2332F662CF3863D40CAF2AAD534D769E20FC7AC678C8793EA761664A68FBCC4C2AC65C33EDC6BA36B3A42AECBA39B3C2583767AE5315FB045F9B095B9DD916AAD3193B0D799E680B3EFB9AB92D147EE64498AE88307CBD9BB927321ED2CBCC7D1161F8FA38F3A05C3B10C7668E8AFA2388C9C9CC9055B26AC82A392D7C8E91AC1AB24ACE318D2D348D2D9D646CA149CE6EBBBE3625AFFDDF79DE64E409C94E2DAF0E9673B2FBFF1A7E9EE325B7193E9BDC113E774AEE12F5E43E9441B116248F04E745C97DE1F3BD594CC6997494B562EC2C77F03A322BDD8845B34C795DF248C4E75C5CFEB3DA429FC189773EEDF2399D6157B3B69BEA3B4CF51EA3AEE3477DE17EF4F5EAEFC9DB66EDF9BF3717C970D63EFD79A86DD660C4F746F8D9C5AC8321F460DC049C63FA7B</Data>              </pcap:TCP>            </pcap:TransportLayer>          </pcap:IPv4>        </pcap:NetworkLayer>      </pcap:Ethernet>    </pcap:LinkLayer> </Packet> </pcap:PCAP> [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. 100m.pcap Command: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/100m.pcap Error message (same for -I null or -I xml): [error] Parse Error: Failed to populate Packet[1]. Expected 1 item(s). Cause: Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100. Schema context: Packet Location line 29 column 10 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 104858829 [error] Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100

              dthompson David Thompson
              dthompson David Thompson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: