CaptureBites MetaServer Version History

 
– ENHANCEMENT: Document number appears in the Document list: The Test Documents Drop Down List and Browse Document Thumbnails now display the document number in front of each PDF file name for easier reference.

– FIX: Export to SAP R/3: After 1 document being uploaded to SAP, the MetaServer service got unloaded. This is now fixed.

– FIX: AFTER A LICENSE ACTIVATION, WORKFLOWS REMAINED HIDDEN: After you activated the MetaServer license, the workflows were not immediately visible. You needed to reconnect to the server of restart the Admin client to see them.

– FIX: ACTION AFTER DELETE WAS NOT CALLED IF DOCUMENT WAS DELETED FROM DOCUMENT LIST: If you defined an action after Deleting a document (like export to a Deleted Documents folder) then this action was only called when you deleted a document with the Delete button in the ribbon in the Organizer or Validation ribbon. It did not call the action when documents were deleted from the list.

– FIX: REJECT REASONS ARE NOW NUMBERED FROM 1: Reject reasons in the Setup UI of the Organizer and Validation actions were numbered from 0 and should have been numbered from 1 because the first reject reason is considered as 1 in the Validation drop down and in the { Reject Reason Number } variable.

– FIX: TABS IN 2D BARCODE VALUES ARE NOW CORRECTLY HANDLED: If a Barcode contained real TAB characters, we now substitute them with the MetaServer TAB character format represented by the → symbol.

– FIX: CORRECT HANDLING OF CORRUPT PDF ATTACHMENTS: Corrupt email attachments were not handled. They are now moved to the Errors tab similar to corrupt PDFs imported from a Folder.

– FIX: A document originating from an email in the errors tab that was deleted did not trigger email archival.

 
– NEW: The Find Word rule will now find words across multiple lines. For example, if you have a text like:

Solutions for SMBs from CaptureBites
Software Development are easy to configure.

Notice how “Software Development is on another line than “CaptureBites”.

If you try to Find “CaptureBites Software Development” with a Find Word rule in that text block, it will now find it. Previously, Find Word could only find words in the same line. This is useful to find key phrases and lookup the matching document type corresponding with that key phrase.

 
– NEW IN ERRORS TAB – CORRUPT PDF HANDLING: When an invalid PDF is imported and detected, it is now reported in the Errors Tab. The viewer shows a red image with the words: “FILE NOT VALID”. The invalid file can be saved with a new Save As function in the Errort tab.

 
– NEW IN ERRORS TAB: SAVE AS FUNCTION: If you want to share a PDF that was moved in the Errors tab, you can now save it on your system with the new Save As function. By default the proposed pdf file name is the original file name of the imported file.

 
– NEW: Week Number – Format Date / Time: We introduced a new output format – Week Number: { Date , W } and { Date , WW } For example 9 JAN 2019 would generate week 2 or 02 (WW).

The 1st week of the year is determined according to the ISO convention: The basic principle is that a week needs to contain all days of the week from Monday through Sunday. This means that sometimes the last week of a year contains days of the following year or the first week of a year contains days of the previous year. According to ISO conventions, the first week of a year is the week with a Thursday in that year. For example 1 JAN 2017 (a Sunday) belongs to week 52 of the year 2016 and 31 DEC 2018 (a Monday) belongs to week 1 of 2019

 
– NEW: Distribute action Help button is implemented.

 
– FIX: Find Word with Accept words from DB: The Match whole word option now triggers an exact match lookup in the database to find mapped fields. Before it did a START WITH search sometimes causing { Multiple hits } in the mapped fields.

 
– FIX: When the workflow is active, and the button is red, the tooltip now indicates “Deactivate Workflow” instead of “Activate Workflow”. When it’s OFF (gray) the tooltip indicates “Activate Workflow”.

 
– FIX: When a corrupt file was imported it stayed behind in the workflow’s the watched folder but was also added to the internal document structure. When you then restarted the server, it failed to restart and was never found until the corrupt documents were removed from the internal document structure in C:\ProgramData\CaptureBites\Programs\MetaServer\Data. In this version, MetaServer cleans up these issues automatically and correctly starts. When new corrupt files are placed in the watched folders, they are now moved to the Errors Tab for further inspection.

Each tab has an online help link explaining all functions:

ADMINISTRATION CLIENT TABS:
1) Server
2) Workflows
3) Queues (planned for future release)
4) Organizer
5) Validation
6) Errors

OPERATOR CLIENT TABS:
1) Organizer (can be hidden if not in use)
2) Validation
3) Errors (can be hidden if solving errors is reserved to admins)

– NEW: WORKFLOWS TAB – WORKFLOW MANAGEMENT: The Workflow management button opens a dialogue to multi-select workflows to delete, activate or deactivate multiple workflows at once.

– NEW: MANUALLY CONNECTING CLIENTS TO THE SERVER: You can now enter the connection URL of the MetaServer manually in the Operator and Administration Clients if they run outside the server’s domain. The URL is accessible by pressing the menu option of the Select Server button. First copy it from the client running on the server and copy it in the Server URL setting on the client(s) outside the domain. This manual connection method is only required for clients running outside the server’s domain. For clients in the same domain as the server, the MetaServer is automatically detected as before.

– NEW: ERRORS TAB: The Errors tab shows any documents in an error state. For example documents that could not be exported because a database was not available. You can view the documents, read detailed error information and after you have resolved the problem, you can retry the failed action or reprocess the error document from the beginning after resolving the issue causing the error. You can also delete error documents from the list in case they cannot be resolved (corrupt unreadable PDF files for example).

The Errors tab also indicates if a document belongs to a document set or not. A document set originates from a single PDF file containing multiple documents that has been separated in multiple documents using separation rules or using the Organizer. If a document belongs to a document set, you have the choice to reprocess the whole document set that the error document belonged to or to just retry the failed action on that particular document.

Through a new group of client settings in the server tab, you have the option to expose or hide the Errors tab in the Operator Client to allow or not allow validation operators to resolve errors.

– NEW: ORGANIZER THUMBNAILS: We introduced a 3rd, Large size type of thumbnail.

– NEW: VALIDATION: DB LOOKUP – “Search as you type” option: MetaServer has always searched records as you typed. This decrease keyboard responsiveness if you lookup in very large tables. You can now disable Search as you type. With the feature disabled you can type in a lookup field and the search will only be triggered when hitting the ENTER key or pressing OK in the Validation Tab.

– NEW: SERVER TAB CLIENT OPTIONS SECTION: You can customize the Operator Client’s experience by hiding or exposing skip functions, hiding or enabling the Organizer tab, hiding or exposing the Errors tab.

– NEW: EXPORT TO WORKFLOW: The Export to Workflow action allows to send documents from one workflow to another preserving all metadata. Ideal for complex uses cases with multiple format output, multi level document separations, document classification etc.

– NEW: DISTRIBUTE ACTION: We were missing a way to export to different workflows conditionally in case we want to classify documents first with a classification workflow. This action makes this possible.

The Distribute action can send a document to one of many workflows or other actions. It is an easy way to create a Document Classification workflow distributing documents to their correct workflow depending on their document type.

This new action allows to send a document to any action in the same workflow conditionally based on for example an index field value like “Document Type”. The field of the value is set in previous extraction or validation actions.

The Distribute Setup has a select field drop down to select a field like “Document Type” holding one of the conditions defined in the list of different possible conditions.

When processing a document, the next action matching the condition value will be selected.

If the field value does not match any of the conditions, the { Default } next action will be selected.

If you name a condition “invalid”, “reject”, “spam” or “delete”, then the action is marked red in the graph and workflow graph.

– NEW: IMPORT FROM FOLDER option to wait x seconds before importing a file. The option is called “Import [xxx] seconds after file creation”. By default the time is set to 0 seconds. The feature is inspired by the fact that some MFP devices (we experienced it with Konica-Minolta MFPs) write PDF files gradually in the destination folder and does not always lock them while being written. This can cause a partial import of a PDF file by MetaServer generating a corrupt PDF file. By setting a delay before importing the file, the MFP can correctly finish the PDF file.

– ENHANCEMENT: F5 can now be used as a keyboard shortcut to refresh lists: like the Document List in the Organizer and Validation tabs, the actions list in the Server tab and the Document Counters List.

– ENHANCEMENT: ORGANIZER VIEWING: If the user clicks on the separator, the first page is now loaded in the single page viewer instead of nothing.

– ENHANCEMENT: ORGANIZER AND VALIDATION – CLOSE DOCUMENT: You can now close a document with a dedicated Close button to make it available for another station to organize/validate.

– ENHANCEMENT: SERVER TAB SELECT WORKFLOWS: The Select Workflow function is now also available in the Server tab. You can use to filter the Import actions in the list. This is useful when you have many workflows on a demo system to reduce the long import action list and only show the relevant ones during demos.

– ENHANCEMENT: HELP IN ALL TABS: A help button is added to each tab opening an online help page explaining all functionality for each of the tabs.

– ENHANCEMENT: The MetaServer version is now included in error emails.

– ENHANCEMENT: Convert to Black & White: Additional info about the conversion process when you press Test with following indications:
If the original contains a scanned page: Yes / No (If No, there is nothing to convert to B&W)
If the original image is black & white: Yes / No (If Yes, the conversion is skipped because the image is already B&W)
If the PDF was converted to B&W: Yes / No

– ENHANCEMENT: We do not allow two separation actions in a single workflow path anymore because, in case of errors, documents can be lost. When publishing such a workflow, an error message shows and recommends to split the workflow using the new Export to Workflow action. For more info how to send documents from one workflow to another, refer to the Export to Workflow online help page.

– ENHANCEMENT: The Exchange error: “Export to Email: Temporary server error. Please try again . PRX5 (451). is now considered as a recoverable error (orange). The Export to Email action will be retried until it works again.

– FIX: Validation: When the field forced a zoom mode, like “fit to width”, the corresponding fit button was not correctly selected when the document was opened in Validation.

– FIX: Extraction Action: The sequence number of the extraction rule in the title of its setup was wrong. If you opened an extraction rule of an extraction action the sequence number in the tile bar was not correct. For example rule 1 was displayed as rule 0 in the title bar or rule 22 ias rule 21.

– ENHANCEMENT: You can now sort the Document list on any of the columns by clicking on a column header.

– ENHANCEMENT: Online MetaServer help now shows breadcrumbs and you can easily navigate to the main help page from any specific help page.

To make a black and white TIF, you should first convert to B&W, then convert to tiff to get a Processed TIF in B&W.

If you want to create different PDF versions, for example one in Color and one in Black and White, then import color PDFs, then export the PDF as is using an Export to Folder action, then Convert to Black & White with a Convert Format action, then export the processed PDF with another Export to Folder action.

 
– NEW: Auto-recovery from offline import and export folders and from timed-out SMTP Servers

 
– ENHANCEMENT: Import from Folder and Export to Folder: When import or export folders are not accessible, MetaServer retries until the folder is available again. This makes MetaServer auto-recover in case a NAS drive is unavailable or after an unstability in the network or if an external drive was switched off and eventually switched on.

Import folders are tested every 10 seconds. Export folders are retried every 10 seconds if there are documents to be exported to that folder.

If network folders are involved, the retry process works in 2 stages, it first tries to reconnect the off line network drive and then retries the import from or export to that folder.

 
– NEW: New option in Network Folders setup: [ X ] Send warning if not available for [ 10 ] minutes.
When unavailable, an email message will be sent after 10 minutes. 10 minutes is the default but this warning delay can be adjusted between 1 and 999 minutes. Only one warning is sent per offline period.

Example:

An import folder is offline because the network attached storage (NAS) was switched off. After 10 minutes MetaServer sends an error message. If the NAS continues to be offline, the warning is not repeated to avoid a spam effect in case a folder is offline for a long period.

After 1 hour it gets finally online again. MetaServer resumes importing automatically.

5 hours later it is offline again. 10 minutes later a warning is sent. Etc.

For exporting documents, the cycle gets renewed per document. Per document there will only be one warning sent after the warning time expires (default 10 minutes).

 
– ENHANCEMENT: Recovery from a timed-out smtp server (outgoing email): Export to Email, Forward Email, Report errors via email all make use of SMTP to send messages. Most SMTP servers set a limit to the number of emails you can send hourly. If you send too many emails in a given period, the SMTP server pauses to enforce the hourly limit. When the SMTP server pauses, MetaServer retries until the SMTP server responds again. MetaServer retries up to 15 times. After 15 minutes MetaServer assumes that there is a critical problem with the configuration or with the SMTP server and generates an error.

 
– NEW: New check digit types used in Find rules and in Text and DB Lookup Validation check masks.

1) Boleto Bancário (Brazil)
2) Burgerservicenummer (Dutch BSN)
3) Luhn Check
4) Spanish VAT Number
5) South African VAT Number

Luhn Check is a popular check digit calculation used for example in:

– American Express , MasterCard, Maestro and Visa credit card Numbers
– Canadian GST numbers (Tax ID)
– Canadian SIN numbers (Social Security ID)
– Mobile Phone IMEI codes (International Mobile Equipment Identity)

 
– NEW: Queue info ( i ) in Validation title bar): A refresh button is added to refresh the number of documents in each action.

 
– FIX: PDFs converted to TIF did not import in Kofax Express correctly because of a redundant tag.

– New Variable: Document/{ Document Dominant Language }: The new version of the OCR engine also detects the dominant language of a document. To detect a language, you need to select it in the language list of the Character Set in the Extract Text rule. The detected language can be used in a field through a Set Field Value rule by setting it equal to { Document Dominant Language }.

– NEW: Server Tab: Network Folders Button: Being a service, MetaServer runs without a logged user account under a special system account. System accounts do not have access rights to shared folders on the network, only user accounts have such rights. This setup makes it possible to define credentials for shared network folders. This gives MetaServer access to import and export to these shared network folders.

The Network Folders button is also available from the Import from Folder and Export to Folder action. You only need to define access to a network folder once. After you have defined access to a network folder, it automatically is accessible from any Import from folder and any Export to folder action.

When you access an MS-Access database through ODBC and the .mdb or .accdb file is located on a network folder, you also need to define access to that network folder using this new function.

– ENHANCEMENT: Export to Folder: Update index file: drastically improved speed

– FIX: Help button now correctly points to https://www.capturebites.com/metaserver/help/Queue Info Button.

We added a small ( i ) button to the title bar buttons on the left side of the help button to display the current queue details. This displays a detailed overview of all documents in the MetaServer queues and lists the number of documents per action.

The Convert to Searchable PDF action has three options:

Option 1: Page(s): Leave the field empty to select all pages. Otherwise, type one or more page numbers or ranges by commas. Negative numbers identify pages starting from the end of the document. For example, if you only want to make the first page and last page searchable, enter 1,-1. If you only want to make the 3 first pages searchable, enter 1-3.

Option 2: Languages: Select the language used in the majority of your documents.  You can select multiple languages, but only do so when you have many documents of all selected languages. If it’s exceptional that you have a document in another language than the main language, only select the main language.

Option 3: To create a searchable PDF, we make use of OCR (Optical Character Recognition) technology. OCR works best on 300 and 400 dpi scans. If you have document scans with a lower resolution than 300 DPI, like 100 or 200 dpi scans, we recommend to use this option to improve the OCR result. This option won’t affect 300 DPI or higher scans.

– NEW:  Set Field: A Line section has been added in the Setup menu of the value, containing:  Line Separator, Line Number and Line Count. Line Number and Line Count are to be used in combination with multi-line values and Line Separator can be used to create multi-line values combining several values.

For example:

If an index field with the name LIST contains these values:
1973
1974
1975
1976
1977
1979

And you use a Set Field Value rule using this value: { Line Number } of { Line Count }: { Field, LIST },
then the result will be:
1 of 6: 1973
2 of 6: 1974
3 of 6: 1975
4 of 6: 1976
5 of 6: 1977
6 of 6: 1979

If you want to populate a field with several lines like:
RED
GREEN
BLUE

You use a Set Field Value rule with this value: RED{ Line Separator }GREEN{ Line Separator }BLUE

– IMPROVEMENT: Workflow definition: We moved all “Convert” options in a “Convert” menu. Two actions are currently available:

• Convert Email Body/URL to PDF (to be implemented)
• Convert to Searchable PDF

For ODBC databases, we do not have the ability to be accent agnostic and you still need to put all variations. However if one of the variations is found and you map fields, the mapped fields will be correctly populated with the values corresponding with the matching accented value.

– FIX: Separate Document / Process Page: Page rotation was not correct during runtime when combined with page deletion.

– FIX: Database Validation: DB Lookup filters did not work correctly resulting in unexpected results.

– FIX: DBLookup: MsSQL lookup did not work correctly and caused an ERROR [42000] [Microsoft][ODBC SQL Server Driver][SQL Server]Ambiguous column name. This is now fixed.

– FIX: Extract Text: If you set a font size range, the & sign was dropped even if its size was in the font size range.

– FIX: Organizer and Validation Title Bars: The imported PDF file name was always named “0.PDF” in the title bar. The name is now correctly displayed.

There are 4 types of mark detection secenario’s supported by the new mark detection rule:

1) YES/NO options: For example: □ I agree with the general terms of this agreement.

2) One of many choices: For example: I am satisfied with the training: □ Strongly Disagree □ Disagree ■ Agree □ Strongly Agree

3) Many of many choices: For example: What languages do you speak? ■ English □ Spanish ■ French ■ German □ Arabic □ Portuguese

4) Signature Detection: Signatures can be detected by drawing a large zone around the signature zone. If the pixel level is above the defined black level, the signature is considered to be present. This is actually a variant of the YES/NO option.

– Enhancement: Format Number: Allow to put more than 9 digits before decimals (leading zeroes).

– New: Help buttons have been added to:

Backstage Tabs:
– Workflows
– Server

Actions:
– Import from Folder
– Export to Email
– Attach index file setup
– Export to Folder
– Email Index, Format setup
– File Index, Format setup
– Export to Database
– Separate Document
– Extract

Rules:
– Find Line with Line Number
– Find Word Group with Mask / Words
– Change Case
– Date and Time

– Enhancement: All demo jobs are renamed and all start with CB, like in CB – FLOATING DATA and CB – INSPECTION REPORTS, so they are all nicely grouped together in the workflow list.

If you installed a previous version of MetaServer, the demo jobs with the old names will still be there. The fastest way to delete the old worfklows is by going to C:\ProgramData\CaptureBites\Programs\MetaServer\Data\Workflows and delete all the *.CBMSWorkflow workflow files that you don’t want anymore. Restart MetaServer by double-clicking the “Start or restart” MetaServer function in the MetaServer folder on your desktop and the deleted workflows won’t be in the workflow list anymore.

– Enhancement: If MetaServer is not licensed and the client is opened, the prompt now shows a button “Request an Activation Code” leading to a form to apply for a production code in case of a purchased license or a trial code to test the product.

– Enhancement: Help buttons moved next to OK and Cancel for both Separate Document / process Page and Extract actions setup.

– Enhancement: The Extract barcodes rule has additional options to supress noisy backgrounds: MedianFilterBias an MedianFilterLevel. We have a project where transparent QR codes are applied on documents and the text shows through the white parts of the QR Codes. Enabling Median Filter and setting MedianFilterBias to 9 and MedianFilterLevel to 7 suppresses the show through text and makes the QR codes readable. Caution: If you push MedianFilterLevel above 7, you risk eroding the QR code as well, making it unreadable.

– Enhancement: Further improvements to Setup variables menus in all windows where variables can be picked from a Setup menu.

– Enhancement: If MetaServer is not licensed and the client is opened, a prompt opens to request an activation code leading to a form to apply for a trial or to get the activation code in case of a purchase.

– Fix: Export to Email: When you typed an email address in the to field, it searched in the fields, resulting in unexpected behavior. For example if you type claes@… etc. and you have a field called cnpj. It replaced the c of claes with a {. This is now fixed.

– Fix: Date Validation: Replace Text option caused an error when text was selected during validation.

– Prototype integration of Convert to Searchable PDF action. Currently the converted PDF is always output in C:\CaptureBites\Searchable with its original file name. In upcoming versions the result will be available as Processed PDF in the export connectors. To access the prototype feature a special installer is required which can be downloaded from here.

– New: Setup windows last used size and position is saved. The main Extract, Validate and Separate action setup windows size sets the size of their child setup windows like: Extract Text Setup, Extract Barcode Setup, Validate Rules Setups, Organize Preview.

– Enhancement: New preformatted date and time formats are added to the metadata pick-lists. Instead having to compose a date format like { Import Date, MM }/{ Import Date, DD }/{ Import Date, YYYY }, you can directly select this from the picklist. This saves many clicks.

– New: Extract Text: Implementation of the options:

“Text based PDF: [ X ] Apply OCR if PDF contains images” and
“Image based PDF: [ X ] Use OCR text layer if present”

Text based PDFs are PDFs that don’t contain an image equal to the PDF page size.

Text PDFs sometimes contain one or more small images containing logos or small font header or footer text. If you want to process these PDFs with OCR, enable the option “Apply OCR if PDF contains images”

Image based PDFs contain an image equal to the page size without any visible text on top of the image.

Image PDFs sometimes contain an invisible searchable OCR text layer. If you want to extract this existing OCR text layer, enable the option “Use OCR text layer if present.

The options are by default Off.

– Enhancement: Report error emails: The email now also includes the path where the document triggering the error is saved:

Example:
The document has been moved to:
Folder: C:\ProgramData\CaptureBites\Programs\MetaServer\Data\Errors\2018.06.11 11.29.52.047

– Enhancement: The default demo folder when an action is opened the first time is now C:\META-DEMO\MFP instead of C:\MetaServer\Test Documents. From there you can browse to the correct demo folder which will be remembered next time you open the action.

– Fix: Export to Folder: Following options are not yet implemented and are therefore hidden from the User Interface:

• Create a document per subfolder
• Metadata file

– Enhancement: DB Lookup Setups: Move “Select data source from field” behind a setup button next to the selected data source. The tool tip of the setup button with the three dots is “Setup dynamic database switching…”. We noticed that inexperienced users were selecting a random field for dynamic DB switching even if they didn’t need it, causing runtime errors. By not directely exposing this setting in the main UI and by considering as an advanced settings, this mistake should not happen again.

– Enhancement: Excel ODBC data sources are now hidden for DB Lookup. When using DB Lookup the data source is both accessed by the client and the server. This is not possible with Excel because it is not multi-user and caused an error.

Excel ODBC data sources are still available for export to database actions because in that case only the server accesses the source. You still need to be careful that Excel sheet is not open in Excel, because that locks the Excel sheet for access and causes an error.

– Fix: Find word with accept words from database – If the setup used mapping and the search returned multiple hits, the 1st value in the BB was mapped or caused an error. In case of multiple hits, the mapping now always results in blanks, so the correct record can be selected during validation.

– Two types changes are allowed without having to recreate the complete result:

1) Delete a text extraction rule
2) Add a text extraction rule: Only the additional extraction rule will be excecuted and the result will be added to the saved result file.

– Saved results are saved per test file in the same file as the test file.

For example the OCR test result for
2003-11-24_Fedex.pdf
is saved as
2003-11-24_Fedex.ExtractTxt

– Fix: With a lookup field with DB match required and look up “without confirmation”, selecting a looked up value in the list, would move to the next document without loading that value completely in the index field.

– Fix: When typing in the DB Lookup field the lookup list did not open automatically.

– Fix: Confirm Lookup option forced the user to hit ENTER twice to confirm instead of once when picking the value from the list with cursor keys or mouse.

– Fix: If DB match was not required and a mask was defined to check manually entered values, this mask was ignored and any value could be entered.

– Fix: If you created an new DB Lookup rule, and you unselected Database match required, the Type list defaults to nothing and pressing setup, causes an error. The type now defaults to Mask / Words. An empty type is not accepted anymore.

– Fix: When you entered nothing in the lookup field, and you opened the lookup list, nothing was displayed. If few records, we show them all. If many records, we display the first 1000.

– Fix: DB Lookup Filter Option: Only the UI was implemented but not the functionality. DB Filtering is now fully functional.

– Fix: DB Lookup Filter Option: The Filter icon was incorrect, it was a magnifier and is now changed to a funnel similar to the filter icon in Excel and Access.

– Fix: MsSQL ODBC – MsSQL tables showed some strange prefixes like dbo.tablename.

– ENHANCEMENT: A lookup field with “Update database” ON, validation is complete and where a new record will be added, a message now pops up: A new [lookup_field name]: [new_field_value] will be added to the [DB Name] database. Are you sure? YES / NO (default is NO). If Yes, the record is added and validation moves to the next document. If No, the record is not added, and the cursor jumps back to the lookup field.

– New: Admin: New server setting: “Queue limit”. The default is 1000. And the maximum accepted value is 25000. The 25000 limit has been tested on our systems and works without problems on a machine with sufficient memory (8GB+) and documents with a standard number of metadata excluding any full text fields. We noticed a considerable drop in performance after 30000 documents in the queue. This is the reason why we have set the limit to 25000.
Although you can theoratically set the queue limit to 25000, we recommend to set the value that you practically need and consider the following when setting the queue value:

The queue value acts as a buffer. Imagine you set it to 5000. That means it stops importing after 5000 documents, but as soon as you validate and a document is exported and exits the workflow, MetaServer will import again until it reaches the buffer level. So, in practice a queue limit or buffer of 5000 is already a lot. If 5000 or less works for you, don’t set it higher.

Each document in the queue also stores all extracted values. So if the documents also have an index field with the full text of the first page for example, then the workable limit is reduced to about 10000 documents or less (depending how many pages of full text you extract and how much memory your systems is equippend with) in the queue.

Often full text fields are used for temporary storage and to extract specific values from the full text. In that case make sure you clear the full text field with a Set Field rule at the very end of your extraction rules to get rif of this redundant information throughout the whole workflow. If you clear the full text field(s) before Validation, the queue limit can be set to a higher value closer to the limit of 25000.

The queue limit sets the maximum number of documents queued for processing. Once this number is reached importing of additional documents is paused until documents are exported and make place to import additional ones. We recommend to keep the value at its default of 1000.

Only increase the value when you want to extract data from a lot of documents overnight to queue them up for validation during day time.

– New: Open Document: Added an option to list more items (up to 9999) – Default is 1000. This setting is remembered per station. Listing more than 1000 items can take a long time. We recommend to keep the list size equal to 1000 or less.

– Enhancement: Export to Folder: FTP mode: Update CSV works in the same way as exporting to local disk.

– Enhancement: Export to Email: A body can now be configured if a “File source” is selected, even when “[ ] Attach files” is not selected, resulting in an email with no attachment but with a body which can contain metadata of the not attached document.

– New: Admin: New server setting: “Queue limit”. The default is 1000. And the maximum accepted value is 25000. The 25000 limit has been tested on our systems and works without problems on a machine with sufficient memory (8GB+) and documents with a standard number of metadata excluding any full text fields. We noticed a considerable drop in performance after 30000 documents in the queue. This is the reason why we have set the limit to 25000.
Although you can theoretiically set the queue limit to 25000, we recommend to set the value that you practically need and consider the following when setting the queue value:

The queue value acts as a buffer. Imagine you set it to 5000. That means it stops importing after 5000 documents, but as soon as you validate and a document is exported and exits the workflow, MetaServer will import again until it reaches the buffer level. So, in practice a queue limit or buffer of 5000 is already a lot. If 5000 or less works for you, don’t set it higher.

Each document in the queue also stores all extracted values. So if the documents also have an index field with the full text of the first page for example, then the workable limit is reduced to about 10000 documents or less (depending how many pages of full text you extract and how much memory your systems is equippend with) in the queue.

Often full text fields are used for temporary storage and to extract specific values from the full text. In that case make sure you clear the full text field with a Set Field rule at the very end of your extraction rules to get rif of this redundant information throughout the whole workflow. If you clear the full text field(s) before Validation, the queue limit can be set to a higher value closer to the limit of 25000.

The queue limit sets the maximum number of documents queued for processing. Once this number is reached importing of additional documents is paused until documents are exported and make place to import additional ones. We recommend to keep the value at its default of 1000.

Only increase the value when you want to extract data from a lot of documents overnight to queue them up for validation during day time.

– New: Open Document: Added an option to list more items (up to 9999) – Default is 1000. This setting is remembered per station. Listing more than 1000 items can take a long time. We recommend to keep the list size equal to 1000 or less.

– Enhancement: Export to Folder: FTP mode: Update CSV works in the same way as exporting to local disk.

– Enhancement: Export to Email: A body can now be configured if a “File source” is selected, even when “[ ] Attach files” is not selected, resulting in an email with no attachment but with a body which can contain metadata of the not attached document.

– New way of concatenating values with Set Field to address issues with word group separators:

If in the Set Field formula, there is at least 1 object without positional data (no pink rectangle), then TABs around values without positional data (no pink rectangles) are suppressed, other TABs are replaced with SPACE.

Something like:
{WGROUP1→WGROUP2}-{WGROUP3→WGROUP4} (NOTE: – does not have postional data)

becomes:
WGROUP1 WGROUP2-WGROUP3 WGROUP4

Something like:
{WGROUP1→WGROUP2}{WGROUP3→WGROUP4} (NOTE: all elements have postional data)

becomes:
VALUE1→VALUE2→VALUE1→VALUE2

Something like:
{WGROUP1→WGROUP2} {WGROUP3→WGROUP4} (NOTE: the space separator does not have postional data)

becomes:
VALUE1 VALUE2 VALUE1 VALUE2

PREFIX{WGROUP1→WGROUP2} (NOTE: the PREFIX constant does not have postional data)

becomes:
PREFIXVALUE1 VALUE2

PREFIX {WGROUP1→WGROUP2} (NOTE: the PREFIX+SPACE constant does not have postional data)

becomes:
PREFIX VALUE1 VALUE2

{ Workflow Name }{WGROUP1→WGROUP2} ((NOTE: the system value { Workflow Name } does not have positional data)

becomes:
WORKFLOW NAMEWGROUP1→WGROUP2

(we may argue that the TAB in the result should become a space in this case because the string contains an object without positional data. However this is such an exotic case, we’ll leave it as is)

{ Workflow Name } {WGROUP1→WGROUP2} ((NOTE: the system value { Workflow Name }+ SPACE does not have positional data)

becomes:
WORKFLOW NAME WGROUP1 WGROUP2

– New: Set Field: New option: [ X ] Replace tabs by [ ] Default is OFF and default value is nothing. When tabs (word group seperators) are replaced, then only the pink rectangle of the first word group in the set field value is kept.

– Server Tab: The Database “Reload” button is renamed to “Load”: Since database updates are loaded automatically, we renamed the Reload database button to Load database. Because it only serves for loading new databases.

– Publish Worfklow: When deleting documents in the queue, a progress windows shows if there are many documents (>100) in the workflow.

– New: Test Folder: When loading a test folder, all the files in its sub folders are also loaded. This allows for easier testing of sub folder names loaded in a field with a Set Field Rule. Consider the selected Test Folder as the watched folder. Subfolders below are numbered 1, 2, 3 etc. Following dialogue use the new Test Folder logic:

ExtractRuleExtractBarcodesSetup
ExtractRuleExtractTextSetup
ExtractSetup
SeparateDocumentSetup
ValidateDatabaseSetup
ValidateDateSetup
ValidateNumberSetup
ValidateTextSetup

– Fix: Set Field: Extract Segment: If a segment does not exist (ex. segment 3 out of 2 segments), an error occurs “Index was out of range. Must be non-negative and less than the size of the collection….”. It should return a blank instead.

– New: When you edit a MetaServer CSV database it is reloaded automatically.

– New: MetaServer CSV databases can now also use ; (semi-colon) as delimiter.

– Enhancement: Publish Workflow: Delete Documents action does not restart MetaServer anymore.

– Fix: Combined word groups are correctly output in CSV, XML files, file names, email body text etc. Previously word group seperators triggered the creation of redundant ” characters.

– Fix: Reload Database sometimes stopped working.

– Fix: Document Separation Setup: The document now stays on the selected page if you change rules or open a rule setup. Before it jumped to page 1.

– New: Find Word: From Database: It is now possible to load an ODBC data source from a field to dynamically switch Database in the same workflow.

– New: Validation: Database Lookup: It is now possible to load an ODBC data source from a field to dynamically switch Database in the same workflow.

– New: Document Separation: When previewing separation points during setup, a progress windows pops up showing page Processing page x of y and also indicates the pages where it found the separation points.

– Fix: Document Separation: Index data of first page of document is kept, also when changed during organize.

– Fix: Export to Folder: File Index: Illegal XML characters are now escaped automatically in any index values or variables in the XML when XML is selected as type. These are the five illegal XML characters that are automatically substituted with their escape code:

” replace with: "
‘ replace with: '
< replace with: &lt;
> replace with: &gt;
& replace with: &amp;

-New: Extraction – Edit – Calculate Date to add or subtract a number of days from a date. For example Due Date = Invoice Date + Payment Term in Days.

– New: Extraction – Edit – Calculate Days Between Two Dates to calculate the difference between two dates. The result is an absolute number in days. For example, Due Date – Invoice Date = Payment Term in Days.

– New: Validation – Dates – new Calculated option – This allows to add or subtract a number of days during Validation by pressing a small calculator next to the date field.

– New: Validation – Number – improved Calculated option – It was already possible to add, subtract, divide and multiply values during validation, it is now also possible to calculate the difference between two dates, resulting in a number of days. That is why thisis part of the Number rule, since the result is always a number.

– Fix: Validate Rule (Edit Text): Replace text had no effect on bar code values.

– When a To email address needs to be defined, the value “change.this.asap@capturebites.net” is set to clearly indicate that the email address should be changed.

– New: Validation / Organizer: New Reserve documents mechanism. It is possible to select one or more documents in the Open Documents list and Reserve them for validation. As soon as the documents are reserved they are not accessible by other validation stations anymore unless they are unreserved. During Validation, the Organizer and Validation clients will first cycle through the reserved documents before opening any non-reserved documents.

– When a a document is reserved in the Organizer, the separated documents are also automatically reserved for Validation.

– New: Fields Setup: Show field in open document list. To help selecting documents in the open document list, additional columns showing fields can be defined. For example if you use a sub folder to set a field called “Scanned by”, you can simply a check a box in the Fields Setup to include it in the open document list. Fields with the same name accros worfklows will all displayed in the same column.

– New: Extraction: New Edit / Reserve rule:

This rule makes it possible to auto-reserve unreserved documents based on an index field. The rule is simple to setup: You select an index field holding the windows user name to reserve a document. You can use standard set field rules, replace rules, db lookup etc. to set the value. This rule will only apply if the document is not reserved yet. For example if the document was already manually reserved during Organize, that reservation is not overwritten by this rule. This is the use case to explain this behavior: Unseparated PDFs arrive in one folder sending it to Organizer with a sub folder per user. Single PDFs arrive in another folder with a subfolder per user for auto-reservation and goes straight to extraction. In extraction just before organize the reservation is set based on the subfolder value. For singles, another extraction just before validate also sets the reservation. However if the unsplit document is first split in Organizer and the auto reserve is manually overwritten in Organizer, then the second auto-reserve in Extraction should not overwrite this. Hence the mechanism to not set the reservation if it is already set.

– New: Validation / Organizer: Open Document List: It is now possible to multi-select documents and delete them all from the workflow.

– Improved: Validation / Organizer Title Bar now shows the original subfolders\file name of the current document.

– New: Validation badge in Taskbar: A counter icon appears on top of the Validation icon in the Taskbar when there is validation or organizer work. NOTE: A small counter on top of an icon in the taskbar to warn the user of pending work is called a badge in MS Windows 10 terminology. The logic is as follows:

– Validation and Organizer Notification edits:

Validation counter = orange

Organizer counter = green

If Validation is active and there are documents to be validated, an orange counter shows the number of documents to be validated.

If Organizer is active and there are documents to be organized, a green counter shows the number of documents to be organized.

If Validation is active and there are no documents to be validated but there are documents to be organized, a green counter shows the number of documents to be organized.

If Organizer is active and there are no documents to be organized but there are documents to be validated, an orange counter shows the number of documents to be validated.

If there are only skipped documents a skipped icons is displayed to indicate pending skipped work. It is Green or Orange depending on what skipped works is pending (Validate / Organized)

– Improved: Redesigned program icons better suited in combination with counter: After installation on a PC with an old version of MetaServer, you need to restart the PC to see the updated MetaServer icons.

– New: New counters in the status bar of validation which indicate:

DOCUMENTS: The total number of all documents in all workflows for the selected MetaServer. This gives an idea of the total load of the server, this number is also indicated in the backstage in the Server tab.

IN ORGANIZER: Total available documents in Organizer for that station (all unlocked unreserved + all reserved documents for that station). This is the same counter as displayed in the taskbar.

IN ORGANIZER SKIPPED: Total available documents in skipped in Organizer for that station (all skipped unlocked unreserved + all skipped reserved documents for that station).

IN VALIDATION: Total available documents in Validation for that station (all unlocked unreserved + all reserved documents for that station). This is the same counter as displayed in the taskbar.

IN VALIDATION SKIPPED: Total available documents in skipped in Validation for that station (all skipped unlocked unreserved + all skipped reserved documents for that station).

All the counters are updated in real time.

– Fix: MS_Status.exe and MS_Organize.exe is now also digitally signed.

– New: Select Workflow button in Validation to select one or more workflows to perform validation.

– New: Find Word Group: A word group is a sequence of words preceeded and followed by a TAB. For example following line contains 3 word groups:

Date: 15 FEB 2018 PO: 987654 Invoice: 123456

The rule also allows to find word groups around a keyword or keywords. You can find word groups below the word Invoice; for example. This is very useful in cases like this:

Date PO Invoice Nr.
15 FEB 2018 987654 123456

In such case, you can find a Word Group containing “Invoice Nr.” and configure the rule to find word groups 1 cm / 0.4 inch below that word group. Resulting in “123456”.

To find the position of a word group in relation to the match, the logic works as follows:

Step 1: Each word group is tagged with 1 of 8 possible location tags (above, below, right above, left, etc.). The centers of the bounding boxes are used to determine the location.

Step 2: Check if the word group is inside the radar (the rectangle around the match) and ignore word groups outside the radar.

For above and below word groups, the distance from the match to the center of the word group is used.
For right above, right and right below word groups, the distance from the match to the center of the left side of the word group is used.
For left above, left and left below word groups, the distance from the match to the center of the right side of the word group is used.

– Included in the installer is an PDF file located in C:\META-DEMO\MFP\FIND WORD GROUP TEST SHEET\MetaServer Find Word Group Test Sheet.pdf. Use it to experiment with the new Find Word Group rule.

The new Find Word Group rule includes many info tips explaining all the options.

– New: Extraction Setup: Measure Tool: With this tool, you can measure an object on an image. This is useful in combination with the new “Find Word Group” rule to measure distances between word groups.

– New: Extract Text setup: When you draw a zone, the dimensions of that zone are displayed in cm or inches and in pixels.

– New: Status Bar shows selected server

– New: Validation: The Original file name, subfolder(s) and workflow are now displayed in the title bar when opening a document in Validation or Organizer.

– Fix: Format Date: On Brazilian machines the date formatter deducted 1 day of the extracted date.

– Fix: Extraction: Test: Improved zooming, panning and page selection when clicking on the result when testing Extraction rules.

– New document variables for last validation station and user who validated the document.

– After installation of this version, delete the temp folder: C:\ProgramData\CaptureBites\Programs\Validation\Data\Graphs. Many files are automatically created in this folder when editing workflows. The new version only creates the graph files, when you press the Graph button. When a Log sub folder exists in the Graphs folder, also the log files are saved.

– Extract Text Rule. New option “Apply if…” to only extract text if a certain condition passes. For example: Extract Text if field value of field Invoice Number is blank.

– You can now copy the “SMTP Server” settings from one action to another even if those actions are not the same. You can copy /paste SMTP Server Settings between the Report errors setup, the Export to Email action and the Forward Email action.

– For consistencty reason we renamed the variables { Reject Error Label } to {Reject Reason} and {Reject Error Number} to { Reject Reason Number }. These variables are located in the Document category of the Setup menu.

– The Email Subject is now configurable with full use of variables in the “Report error” setup and in the “Forward Email” action.

– The Archive action is now hidden and automatically used when required.

– Workflows: The Graph button now generates a graphical represenation of the selected workflow

– Defective PDFs generates with mobile apps or scan apps that don’t specify a resolution tag are now correcty processed.

– PDF “Page Count” Metadata in Import/Source/File/Page Count is now available.

– Validation: Select Text: Select 2 or more lines of Text in a text field rejected the value with an error. Now the lines are correctly concatenated in the field and accepted.

– Extraction: Test: When a result is selected the viewer now jumps to the correct page where the result is extracted from.