Integrations: easy as right-click, “new folder”

Community Topic(s):

Keywords: OCR, ECM, integration, data capture

Current Rating:
(0 ratings)

When it comes to enterprise technology, let’s face it, the more complicated the better.  Complicated enterprise technology is job security, ensures premium software prices for vendors, and keeps the entry barrier high.  One of the biggest challenges in enterprise technology, especially ECM, is integration.  Integration between ECM components such as imaging to ECM, or integration between one ECM to another can often be the biggest cost and challenge of any implementation.

In this post, I would like to talk about why the integration between imaging applications and ECM systems should be the lessor consideration when choosing capture software, and why it can be as easy as creating a new folder.

Because data capture and other document imaging technologies require significant focus, adding other complexities such as integration can force a project to never start, or force an organization to choose a technology for the wrong reasons.  I’ve seen companies in the past pick capture software just because they exported to one specialized file format.  The result was an inadequate capture application with a stellar export.  What is the value of any exported data if the quality is poor?

For this reason, I coach companies to focus on the export format as the very last aspect in their capture product decision making process.  I also explain that for MOST packages it’s possible to create any conceivable export, so as eliminate the concern all together.  If the data is there, 99.9% of the time it can be massaged into any shape you desire.

Not only does the export format come under fire, so does the means of delivery.

Most organizations when it comes time to consider the transfer of images and data from data capture application to Enterprise Content Management system ask for a connector specifically written to incorporate the chosen imaging applications API to pass images to the chosen ECM applications API. API to API transactions are the best way to ensure features and stability, but at what cost.  Most pre-created connectors were made for the purpose of a brochure and not for production. I'm not sure what to blame, the warm and fuzzies that come from the realization that an OCR or ECM vendor has spent specific effort to develop your specific connector, or the faith that somehow these special connectors are better. What I do know is that in most all cases connectors are overkill and simply not necessary. Why? Because there are hot folders, and they are amazingly powerful and simple.

A hot folder ( sometimes called a watch folder ) is a directory virtual or real that is setup to be a staging location or queue for applications to put data into, and take data out of in real-time. The best thing about hot folders is they are free! Most all imaging, data capture, and content management applications support hot folders. If they don't, you have every right to ask why. When a scanner produces images, they can store the images automatically into a folder. The data capture application can automatically read images from this folder as soon as they appear. After data capture and OCR has done its thing, the results can be automatically exported to another directory that a content management application can automatically pick up from. That is two folders vs. two pricey connectors.

Very often custom built connectors use the hot folder approach, just without you knowing.  Ideally, API to API is the best way to go, but most connectors are not utilizing all the features you require anyway.  The upshot; if you need an API to API connector, build it yourself or through professional services to be exactly what you want.  If you don’t need it, then use a folder!  In the end how data moves from one application to another is NOT the most important feature of the product, rather focus on its core functionality and what it was built to do, data capture for data capture, ECM for content management.

Report

Rate Post

You need to log in to rate blog posts. Click here to login.

Add a Comment

You need to log in to post messages. Click here to login.

Comments

Daniel O'Leary

In 10 minutes over a lunchbreak. Not kidding. Do you have cameras in my office Chris?

We got a call from a customer that wanted to store forms and documents in Box, and had it up and running in 10 minutes using hot folders. Chris is 100% right on this one, less code is always better than more code. Shortly, we'll expand with their API, since it's free, and super simple to integrate. Legacy vendors that charge for APIs and have closed platforms are in deep trouble.

http://www.youtube.com/watch?v=XkT-RtlzY04 - hot folders in action!
Report
Was this helpful? Yes No
Reply

Several companies are doing very well in the Distributed Capture space utilizing Multi Function Copiers. Integration to a backend like FileNet, Oracle or SharePoint is the general requirement but most often the documents need to be routed through a Create Route and Approve workflow process. The steps in the workflow are often not very complicated but this creates 2 possible integration points.

First you have to decide whether you want to integrate the MFD at the panel or utilize secure hot folders. Personally I prefer the hot folders approach due to the lifecycle on MFD's being 2-4yrs. More on this can be found here http://independentintegratorsofecm.wordpress.com/?s=MFD

Once the MFD has been integrated with a Distributed Capture platform and the workflow has been configured the second integration point is archiving the captured transactions to the backend repository. This can be done using hot folders but I agree with Mr. Riley that the best option is API integration. The transactions should exist in either the Capture software as a transactional batch or the backend repository. Trying to peice together batches of scanned documents in a hot folder when a hardware or network communication failure occurs is a nightmare and often results in lost documents requiring rescanning.
Report
Was this helpful? Yes No
Reply

Nick Caruso

Chris - I found your article interesting, but I feel it's important to highlight a few items regarding a "hot folder" approach. While simply placing an image in a hot folder is quite streamlined, and may be appropriate in certain situations, it's important to note its draw backs.

1.) From a security perspective and most importantly, you'll have a difficult job of tracking user based activity. If the MFD is just scanning to a hot folder, you will lose context of who scanned the document.

2.) Yes, companies swap out MFD manufacturers every few years, but most capture vendors now offer integrations into many MFD brands, so a company may still use the same capture platform capture regardless of the capture source.

3.) Having a knowledge worker pass index information along with the scanned image can vastly improve the following business processes. Tagging scanned documents with metadata at the time of scanning such as invoice ID, etc. can significantly improve the quality of the data captured with the image.

Report
Was this helpful? Yes No
Reply

This post and comment(s) reflect the personal perspectives of community members, and not necessarily those of their employers or of AIIM International