Plain Text (.txt) File Capture

In addition to ingesting standard serial data newswires and XML files, Burli can automatically detect text data in a given directory and import it into the In-queue.

This is useful for importing text from other software, FTP sites, custom data feeds, etc. which must immediately and automatically appear in the In-queue as though it was from a standard wire service.

TXTIPT on the Newswires2 tab allows import of plain text data from files on local or network drives.

Configuring Text Import

Open the configuration screen in Burli (Shift-F8 or Config | Program Setup). Enter the password, if prompted for one. Select the Newswires2 tab.

Note that some in some installations you may see two Newswires tabs. The one called “Newswires2” should only be used. The older Newswires tab is not multitask capable and is the older method.

Select TXTIPT (or TXTIPT 2,3,4,5 or 6 – they all behave in the same way) from the list.

  1. Click the Install… button. A dialog box appears.
    Text Import options
  2. Enter a directory to monitor. Use a full UNC path. Drive letters (including mapped network drives) are allowed. Be sure to use \\ before a machine name.  If using an FTP site, be sure to enter all fields.
  3. Select other options as required (see below).
  4. Click OK

Burli will now monitor the given directory\ftp site and add any items it finds to the in-queue.

More Settings

Both the UNC and FTP settings screens offer additional options, some of which you will need to set for successful data collection:

Include Sub Folders – will include any valid files it finds in sub-folders of the folder defined above.

Exclusive Access – will lock the file while Burli is ingesting it. Sometimes required for successful import of files over slow connections where multiple newsrooms may be using the same file. Not usually required (as multiple systems should be able to read the same file from the server at the same time without issue) and it may cause problems for other ingest systems if you turn it on unnecessarily.

Passive Mode – uses passive (PASV) mode to connect to the FTP server. Sometimes required to get through your (client-side) firewall.

Auto Purging Files – Deletes the file once Burli has successfully ingested it. Double-check that no other newsroom or system needs the same files before turning it on. Some services, however, will never delete the data files, so this setting may be critical to prevent folders from filling with old data. Some folders may have security rights that prevent Burli from deleting files, in which case this function will not work.

Files older than – Prevents Burli from ingesting files that have been on the server less than the specified number of minutes (values of less than 1 minute are not allowed). Over slow Internet connections it can sometimes take more than a minute or two for the complete data file to arrive in the folder. If this setting is not checked, Burli may try to ingest files that have only partly arrived. If you receive incomplete data, try using this setting. Please be aware that the time is relative to the FTP Server timezone. If the FTP site if not in the same timezone as you, do not check this box or contact Burli Support for additional settings.

Files newer than – Prevents Burli from ingesting files that are more than x hours old. Some folders contain data files that date back days or even months. When you connect to the server, you may want Burli to ignore the old files to save bandwidth and prevent the system from becoming cluttered with old data. Burli does keep track of which items it has ingested, so this setting is not needed in normal operation. But where you connect to a folder that Burli has not downloaded from in a long time, it can be very useful. Please be aware that the time is relative to the FTP Server timezone. If the FTP site if not in the same timezone as you, do not check this box or contact Burli Support for additional settings.

File Filters – specifies which file types Burli will ingest from the folder. Wildcards are allowed. Separate file types with a ; (semicolon) but no space. If this field is left blank, Burli will not ingest any files. For TEXT file ingest, this should be set to *.txt
*.* – will ingest any file it finds in the folder
*.xml – will ingest any file with a .xml extension
*.txt – will ingest any file with a .txt extension