Uploaded image for project: 'Polyglot'
  1. Polyglot
  2. POL-164

special characters in file names caused downloading errors in Software Server

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: To Do
    • Priority: Normal
    • Resolution: Unresolved
    • Labels:

      Description

      Noticed once on 8/13 and again in this week's debugging of polyglot issues.

      Software server had problems downloading files with special characters "[", "]" , "#" in the "ebook-convert" queue, and failed to process it. The queue has 1400 msgs, and 4 extractors listening on it, but the queue gets stuck and no msg is being processed. The URL is:
      http://141.142.227.81:8184/file/dillonMETADATAFORM[2].doc

      Update: other files with "#", "[", "%" also had problems:

      [Thu Sep 17 17:45:16 2015] [restlet] [397]: Downloading http://141.142.227.81:8184/file/Security_White_Paper_#001_-_Incident_Computer_Security_Procedures.doc (-1 B) ...
      [Thu Sep 17 17:48:44 2015] [restlet] [119]: Downloading http://141.142.227.81:8184/file/CheyenneWellsMETADATAFORM[2].doc (-1 B) ...
      [Thu Sep 17 17:51:56 2015] [restlet] [384]: Downloading http://user1:pass1@141.142.227.81:8184/file/5%_PUMS_README.doc (-1 B) ...

      SS log is below. Note the "-1 B" and size of 0 in the generated PDF file, indicating a problem.

      Software server is running ...
      Starting the internal HTTP client
      Starting the internal [HTTP/1.1] server on port 8182
      Starting edu.illinois.ncsa.isda.softwareserver.SoftwareServerRestlet$2 application
      Connecting to RabbitMQ server and starting consumer thread
      [Thu Sep 17 17:31:44 2015] [rabbitm] [200454457]: Consuming job-200454457, http://user1:pass1@141.142.227.81:8184/file/dillonMETADATAFORM[2].doc->pdf via ebook-convert
      [Thu Sep 17 17:31:44 2015] [rabbitm] [200454457]: API call, http://localhost:8182/software/ebook-convert/convert/pdf/http%3A%2F%2Fuser1%3Apass1%40141.142.227.81%3A8184%2Ffile%2FdillonMETADATAFORM%5B2%5D.doc
      [Thu Sep 17 17:31:44 2015] [restlet] [423]: Setting session to session-423, result will be at http://141.142.204.152:8182/file/423_dillonMETADATAFORM[2].pdf
      [Thu Sep 17 17:31:44 2015] [restlet] [423]: Downloading http://user1:pass1@141.142.227.81:8184/file/dillonMETADATAFORM[2].doc (-1 B) ...
      .
      [Thu Sep 17 17:31:45 2015] [sserver] [423]: Executing, scripts/sh/ebook-convert_convert.sh /home/polyglot/polyglot/tmp/SoftwareServer/Cache/423_dillonMETADATAFORM[2].doc /home/polyglot/polyglot/tmp/SoftwareServer/Cache/423_dillonMETADATAFORM[2].pdf /home/polyglot/polyglot/tmp/SoftwareServer/Temp/423_1442529105134_ ...
      ..
      [Thu Sep 17 17:31:46 2015] [sserver] [423]: Killing, scripts/sh/ebook-convert_convert.sh /home/polyglot/polyglot/tmp/SoftwareServer/Cache/423_dillonMETADATAFORM[2].doc /home/polyglot/polyglot/tmp/SoftwareServer/Cache/423_dillonMETADATAFORM[2].pdf /home/polyglot/polyglot/tmp/SoftwareServer/Temp/423_1442529105134_ ...
      [Thu Sep 17 17:31:46 2015] [restlet] [423]: Execution complete, result at /home/polyglot/polyglot/tmp/SoftwareServer/Cache/423_dillonMETADATAFORM[2].pdf (0 B)
      [Thu Sep 17 17:31:46 2015] [restlet] [423]: Copied result to public folder

        Gliffy Diagrams

          Attachments

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              ruiliu Rui Liu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Tasks