Getting better reports out of your accounts package. By David Carter

Inadequate reports have been a source of complaints ever since accounting packages were invented. Now at last a solution may be on the horizon. David Carter discusses the issues and finds that all roads lead to Microsoft.

Management reporting tools have improved greatly over recent years, and with Windows it is much easier to gain access to data. ODBC enables you to create reports that are directly linked to the company database. An IT literate accountant can use Crystal Reports or Excel pivot tables to create extremely sophisticated reports.

Continued...

» Register now

The full article is available to registered AccountingWEB members only. To read the rest of this article you’ll need to login or register.

Registration is FREE and allows you to view all content, ask questions, comment and much more.

Comments

Purpose of a Manual

Anonymous | | Permalink

This is a fascinating topic and even more interesting is the lack of Standard report fields or seemingly the will to suggest any Standards.

If Standards are in place covering 75% of reporting requirements then to a large extent the need for access to the underlying data is reduced; unfortunately so is the 'fun factor'.

When Standards are combined with Data Dictionaries (or an exposed object model) then just about all the eventualities are covered.

With todays software, data is held in tables and may only form part of the story. Without an overall knowledge of the underlying Object Model / Data Structures, giving access to the database may cause more problems than it solves.

As an example - data in some tax products is XML based; which is then held in a single or multiple fields in the database. In order to use this data it needs to be retrieved from the database and parsed into an Object Model (classes / objects) before it can be used. In such circumstances providing access to the database tables would not be productive.

Many databases also consist of multiple tables and relationships (200+) and frequently have Metadata driving other data - again fairly meaningless when accessing the base tables, unless one knows the structure. Furthermore without an explanation of the enumerated constants used in the program one is also at a loss.

Ok - so once the manual deviates from being a User Guide and into the realms of the technical area, where does one draw the line?

For a vendor to fail to produce a User Manual is bad practice - however, one could argue that to turn the User Manual into a technical specification is also bad practice and not the function of a manual

Human link

AnonymousUser | | Permalink

Richard, it looks like there's a missing human link (of know-how) between yourselves and your vendor; each expecting the other to supply it.

Richard Willis's picture

Manual, what manual?!!!

Richard Willis | | Permalink

Hiran says 'if the manual is deficient' etc.
It may be indicative of the problems that we are facing to say that, after 2years in the marketplace our vendors are yet to produce a manual for our package, nor is there any sensible on-line help facility!!! It IS MS SQL-based, and yes, there is a data dictionary.

When, on one accasion, I questioned why I could not access a certain field in G/L journals, the answer I got was 'well you only know it exists because you looked in the database'!

Views for all

AnonymousUser | | Permalink

What a lovely debate and full marks to David and all the contributors.

If the accounting package provides sufficient documentation of tables/fields (reference manual) simple drag-and-drop from the visual tools in our everyday tools should suffice, without having to rely on techies. The visual inteface in SQL Server is similar to that in Access (where they're called Queries, a topic covered in any starter course. Both Access and SQL Server write the SQL code for you in the background. Oracle too). For views/queries the brand/vendor of accounting package is unimportant - it's just the underlying database you are dealing with. Ok, if the manual is deficient you might need a short conversation with the support people. Also, creating a view poses no threat to the integrity of the accounting data if it is read-only, and as noted already, it is a once only task that should take no more than ten minutes, and (hey) it's a lot of fun.

As David says, after that we can report to our hearts content - with Excel, reporting tools, direct to dynamic web pages (always live, on-demand and real-time), anything ...

Ten minutes. Happy to show anyone how. Free.

Hiran de Silva
hiran@desilva.com

Richard Willis's picture

I would love to tell, but...

Richard Willis | | Permalink

My reluctance to tell which package we use is not really based on a desire to ensure that others are inflicted with it. It is because the situation with the sotware house is a little delicate at present! Suffice it to say that in the process of arriving at a remotely useable solution, we logged £30k + of lost or wasted man hours.

With reference to the reporting functionality, an example. The package has no means of reporting the totals of ALL warehouses in the stock, such that one can vouch the G/L balance -v- Stock inventory. It gives a single report for each warehouse, but we have about 200 virtual warehouses, many of which are empty, or should be. Short of running the said report for all 200 of them, one cannot see which have a balance, right or wrong. Only by using external data in pivot tables have I been able to achieve any semblance of a handle on our stock position. I can now output either the G/L total by warehouse, or the entire stock by Item by warehouse, both balancing to the G/L account to within a GBP (rounding/Currency diffs.). Without Excel we would be lost!

in for a pound

David Carter | | Permalink

Hi John

Richard says he uses "Office/SQL facilities", so I'm not sure if his system runs on SQL server. Even if he does, it sounds like he doesn't have data dictionary so it's going to be a messy job pulling the data together.

Richard is obviously a very ingenious chap and well done to him. The trouble is that, by using his ingenuity to get round the problem, he's solved the problem and let the vendor off the hook.

That's why I am so strongly against packages which are bad at reporting. Responsibility has to be placed firmly where it belongs - with the package vendors. We will only get any improvement when they start to take notice.
David

listerramjet's picture

horses for courses

listerramjet | | Permalink

my own view is that software should be written to provide the best functional solution. In this day and age the best solution is using a SQL type database (of which microsoft SQL server is a well known example). If the application is well written it will provide a stable transactional environment (so that it always balances), and it will use business rules to maintain its database (so that transactions are processed consistently, regardless of source). The typical user should be blissfully unaware of all of this.

whilst presentation methods change, reporting requirements are generic. For example, executives are usually interested in highly aggregated numbers, but managers require lots of details. And some managers require financial stuff, some require operating stuff, some require marketing stuff, etc; and most require the ability to produce stuff that is non-standard, so the provision of a raft of generic reports is not the modern answer.

data views available to analysis tools (such as Excel), where the data items are either logical and/or defined (so the user is able to know exactly what is being provided) is a good answer, and something that SQL products are able to provide. which is why it will be interesting to see what microsoft produce. If the user has to interpret the raw data tables the chances are that (s)he will get it wrong.

because this is all relatively new, it is not surprising that most offerings provide generic reports, and a report writer looking at the raw tables; and thus it is also not surprising that most users view the reporting aspects of accounting applications as poor.

Standards - Required Reporting Fields

Anonymous | | Permalink

Sql Views are not issue because they are relatively simple to implement. Agreeing on their content and the necessary end reports is the problem.

This is where the profession could make a major contribution to the whole process. It should be a fairly simple matter for the profession as a whole to decide upon the minimum number & type of reports (together with their content) and this could be used as the basis for future progress.

The benefits of a standard approach are immense - no more re-inventing the wheel each time in Excel, reduced time/costs standard formats for comparison etc...

The requirement is to analyse the problem and provide as near generic solutions as possible. If the template solutions provided are deficient then they need to be added to over time until a definative model exists for industry sectors.

It should not be an insurmountable task but it falls to the profession to set the ball rolling

Finally as a pre-requisite Microsoft Excel should correctly write csv files - see

http://support.microsoft.com/default.aspx?scid=kb;en-us;77295

The analysis-ready file concept

David Carter | | Permalink

Neil has made a couple of points, one valid, the other a misreading of the "analysis-ready file" concept I mentioned.

1) As he says, any enquiry on the data constitutes a "view", so Views are not peculiar to the MS SQL Server database. It's just that I've gone through this exercise now with 3 software vendors and the last two both happened to run on SQL Server. With these two, creating the View proved to be remarkably easy. However, the third package was TAS Books, which I think is VB and Pervasive SQL, so it is true that views can be created for packages in any database.

2) Neil then says: "The problem is when the view changes, which it will do". But the key point with the “analysis-ready" file concept is that the view doesn't change because it is a generic view which contains all the fields that users will ever need to make their reports. To repeat from the article:

In practice, only two analysis-ready files are required in order to produce the great majority of reports an organisation needs. A Nominal Transaction file is required for analysing costs in the Nominal Ledger, and a Sales Invoice item file for analysing sales by product. Each comprises about 40 fields apiece, maybe 15% of the data fields in an average mid-range package."

Once a package offers these two files/views, users now go to them in order to create all their reports. There's no need to go near the raw data tables or construct SQL queries again.

The second SQL server package I was talking about is a well-known accounting vendor. Hopefully, they will be releasing their analysis-ready file pretty soon and we can see how the idea works in practice.

PS John,
I couldn't disagree with you more. For me reporting is absolutely fundamental. If I find a package that's bad at reporting because it hasn't got a data dictionary or whatever, then as far as I'm concerned it's a write-off, even if it has just won an award for being the best mid-range accounts package on the market.

jacp400's picture

In for a penny...

jacp400 | | Permalink

Hi David,

Maybe I'm missing the point then? Surely if Richard's software is based on SQL Server then he can use the tools that your article advocates?

Regards

John Clough
Numerica LLP
Tel: 023 8070 2345
john.clough@numerica.biz

Actually, I think it's spot on...

sctwynham | | Permalink

<can content="worms" status="open">

There is a common thread amongst the IT community to presume that anyone that doesn't know their right outer joins from their left ones, can't tell SOAP from UDDI, or can't disassemble a printer driver at 30 paces must be somehow inferior. Yet it is this mentality which keeps 99.999% (five nines!) of IT people away from the boardroom and locked away in some darkened computer room!

I don't care how sheering forces impact the viscosity and flow parameters of diesel oil at the extremes of temperature and pressure - I just turn the key and my car starts.

So why should Accountants / FDs / CEOs *have* to care about Structured Query Language or whether this transaction table requires a right outer join with that one? Yes, it's easy when you know how, but that's not the point...

</can>

Stewart Twynham MBCS MIEE
stewart@bawden-quinn.co.uk

Horses for courses for the SME

dclark | | Permalink

I agree with the writers who say "you shouldn't need to know how it is arrived at, just that you can do it"

I would start by saying that (and it still is a big assumption) hopefully you can assume your solution can give you all the standard reports (day books, aged listings, etc) without too much difficulty, but I'd suggest that what users should consider and demand to see during the software purchase process are all those slice and dice reports that they need to really run the business, that in the end point to the concepts being talked about (tables, links, queries, relational databases) being dealt with behind the scenes. You can always find a package where the query process is written so badly the database increases as the day progresses

Most industries have the vast majority of their business units made up of small and medium businesses. It is these businesses that can't afford specialist IT support, so are relying on the package (even if it is largely bespoke) to have already dealt with these problems. I think getting an SME's to understand about a flat file is a bonus. I know I can do loads of slice and dice in SAP, I know I can do some in Quickbooks, but the trick is for the purchaser to know what they need to run their business and trade it off with the price being offered by the software vendor. David has written some excellent stuff on the use of excel for users of Sage and for users in general. I'd still see this as the major tool for the SME. I have looked at many reporting tools that take raw data and enable you to slice and dice, but as an ex-FD, I used to reduce the number of reports until someone screamed. Then I knew there was a possibility it was an important report. In the end it is likely that 20% of the available reports provide 80% of you required needs. I'd find a package that gets close to that 20%!

Kind Regards

Daniel Clark
Ryba Macaulay Ltd
info@ryba-macaulay.co.uk

Mmmm.

NeilW | | Permalink

With any proper database it is always just one operation to create a 'View'. After all they are just stored queries.

The problem is when the view changes, which it will do.

The main issue you will have with any database is relating the tables together, and understanding what the things mean. And for that you need to understand SQL query language and how to use it.

It seems to me that the author of these piece is either heavily dumbing down for the audience, or fundamentally doesn't understand the nature of relational databases.

NeilW

Re: Nice selling spiel for Microsoft

sctwynham | | Permalink

Yes, but, I think the point David was trying to make is that not every small business has a handy team of Analysts and DBAs creating and running complex queries on a DB2 UDB DBMS running on an IBM mainframe.

Yes, Microsoft is behind the curve - but if their previous "me too" ventures are anything to go by, they'll take the best bits, add usability, take away the price and exploit their market dominance to deliver something to the masses.

And, no, it won't be good enough for the purists or the developers amongst us, but it will be perfect for the accountant bod sat in a darkened room in XYZ manufacturing.

Which at the end of the day is all that matters...

Stewart Twynham
stewart@bawden-quinn.co.uk

cutting out the techies

David Carter | | Permalink

As Caroline says, I am talking about data warehousing here, which has been around for a long time along with BI tools, metadata, etc.
However, because the source data in transaction processing systems is spread all over the place, data warehouses are complicated and expensive things to set up and it all has to be done through the IT department.

But with SQL server it is a once-off task to create a "View" which pulls all the data into a flat file. And once this view has been set up you can create any report you like without there being a techie in sight.

Most readers of AccountingWeb are end users and want to avoid being beholden to the IT department. Soon they will be in a position to create all their own reports without having to join tables or call in IT, and that's good news.

David Carter

jacp400's picture

Challenge for software authors

jacp400 | | Permalink

It must be difficult for software authors.

As even just these few responses show, software authors have to cater for everyone from the systems accountant who wants all the tools, to the FD/MD who just wants to press a button without care for how the tables link together (please dont reply in respect of my stereotyping).

So as a software author you have 3 choices:

1. Build a comprehensive set of proprietory reports.

2. Allow open access of the database and rely on the inbuilt tools, MS Access, MS Excel etc, or other third party tools such as Crystal Reports, Cognos etc.

3. Build a number of reporting and enquiry tools so user can use their preferred method, AND allow open access to the database, links to Excel etc.

From our experience, even the latter attracts complaints of confusion that the user doesnt know which method is the best to retrieve their information.

This further proves the theory; you can please some of the people all of the time...

PS David, I think it's a bit disingenuous to out the software that is difficult to report from to "save some readers from making an expensive mistake" as reporting is only part of the equation when choosing an accounting package, especially as Richard mentions that he can report using Office/SQL facilities which would certainly suit some users.

Regards

John Clough
Numerica LLP
Tel: 023 8070 2345
john.clough@numerica.biz

Please tell

David Carter | | Permalink

Richard, please tell us what your package is. You would be performing a public service and might save some readers from making an expensive mistake.
Or look at it another way: once the problem is out in the open, your vendor might actually feel obliged to sort it out.
Speak, please!

Richard Willis's picture

I am accounting bod from XYZ Manufacturing!

Richard Willis | | Permalink

As one who has to struggle daily with an integrated system in which the reporting most certainly WAS left 'till later, I must say that without the ability to use the MS Office/SQL facilities, I would be totally lost. As I have said in another string, I won't say what package we use; why should I be the only one to suffer!!!