Deep Log Analyzer - FAQ. Website Visitors Analysis


What is hit and visit in Deep Log Analyzer?

Hit is a single action (for example, a click on the link) taken by a user at a website that corresponds to one line of data in the web server log file.  When user request a web page browser also requests all graphic elements on located on that page. Each of these request results in a separate hit recorded to log file and respectively
imported by Deep Log Analyzer.

Visit (sometimes also called visitor session) is a sequence of requests (hits) made by a user. Visit begins either when user is referred to the site through a link on other website, or he types your site URL into his browser address field (direct request). Visit ends when there are no additional requests made by the user during the period of time specified in project settings (default value is 30 minutes).

What volume of web server logs can be imported by Deep Log Analyzer?

Deep Log Analyzer imports data from log files into MS Access database. It uses separate database mdb file for each project. A single mdb file can have size up to 2 Gb. Data in a database is organized in much more efficient way than in raw log files since database is designed according to normalization rules. This is why log files take less space in the database than their original size. Also Access database can be compressed to take even less space. Also it is recommended to filter out graphics requests in project settings in order to have a smaller database.

How do I optimize Deep Log Analyzer to work faster?

Take into account that Deep Log Analyzer uses an advanced report caching technique for opening reports faster. This means that a report’s query is actually executed only when you open report for the first time. Next times report has been loaded from a fast cache and it takes much less time. It allows you to browse your website statistics complex reports in real time without any delay.
Here are some additional advices to make Deep Log Analyzer even faster:

  • Consider not importing graphics requests into the project database. Unmark corresponding check box on Excludes tab in Project Settings. Graphics requests usually take about 2/3 or more of all hits and have very limited useful information in them. Excluding improves logs import and report creation speed several times and makes your project database a few times smaller.
  • Do not import into the database hits generated by visitors from your company. Such “inside” visits can become a substantial part of all recorded web site activity. Excluding such hits improves import and report execution speed and results in less database size as well as makes your reports more accurate since they include only activity of your real visitors. Enter your companies external IP addresses in list on Exclude tab in Project Settings.
  • Consider creating new projects more often. Instead of importing all log files for your web site life time in a single project in Deep Log Analyzer create new project every quarter, month or even week (for larger web sites). Keep old data in other projects so that you could concentrate on the situation on the website. This will make reports much faster and easier to work with by eliminating data for unnecessary time periods. Use wildcards to specify log files sets for particular dates, for example c:\logs\ex0406*.log will import only log files for June 2004.
  • When importing log files click Background button located in import dialog window. This will minimize Deep Log Analyzer to system tray and it will continue importing process in the background allowing you to work comfortably with other programs. Deep Log Analyzer will be restored from background automatically when log parsing finishes.
  • Make sure your computer configuration matches the minimum system requirements.
    Basically Deep Log Analyzer performance
    depends most on two main factors: hard drive speed and CPU
    speed. Computer also should have enough RAM – 256 to 512 Mb is
    appreciated.

How can I make Deep Log Analyzer recognize more search engines?

Deep Log Analyzer currently can recognize more than hundred most popular internet search engines like Google, Yahoo, MSN, etc. In log file it can find search engine name and key phrase that referred visitor to your website. If you receive hits from some local search sites, you can add them to search engine definitions in search_engines.ini file.

They will then appear in all search engine reports in Deep Log Analyzer. Open search_engines.ini file in Notepad, add new line in the format like SE114=MySearchEngine into [SearchEngines] section. Than add new [MySearchEngine] section at the end of file and list the values that tell how to recognize hit from this search
engine:

EngineIndicator1=mysearchengine.com

EngineIndicator2=mysearchengine.net

SearchPhraseIndicator1=?q=

SearchPhraseIndicator2=&q=

This allows to recognize referrer URL like http://www.mysearchengine.com?q=phrase1 as a hit referred by MySearchEngine with search keyword “phrase1” Search engine definitions are processed at the time of log file parsing, so the newly added definitions will work only for logs  that you import later on. You may re-import log files to apply changes to all imported data. It is recommended to back up ini file after editing or it will be overwritten if you reinstall the program. Or just keep a copy of added records in a separate file.

How to add browser, spider or OS definitions?

You can add custom browser, search engine spider and OS definitions in user_agents.ini file. Look at Unrecognized Browsers report. It shows all User Agent fields found in imported log files that are not described in user_agents.ini. If you get lots of hits from some kind of user agent (for example new download manager) that Deep Log Analyzer does not recognize, you can add custom definition for this user agent. It will be then recognized as a standard browser. Definitions should be entered in the following format in [Browsers] section:

BROWSERXX=[Name],[Log file stamp used to find it]

For example: BROWSER22=ReGet (downloader),ReGet

The same format is used for search engine bots ([Spiders] section on user_agents.ini) and OSs ([Platforms] section in user_agents.ini). Back up edited ini-file as it can be overwritten when you install new version of Deep Log Analyzer.

Can I create my own reports in Deep Log Analyzer?

You can design you own custom reports using SQL queries. It is potentially possible to create report on any aspect of the  website usage you may ever need since all data from log files is imported in a well designed relational database. You may create new report based on any standard report. In this case SQL query will be copied to your new report and you’ll be able to edit it. Deep Log Analyzer has advanced SQL query editor with syntax highlighting. To design good and useful reports you have to becom familiar with database structure that you can see in diagram.jpg file provided with the software. Contact us in case you require assistance with designing your custom reports.

What log file do I need? Where can I get the log files?

Deep Log Analyzer needs web server log files in order to analyze your web site and create reports. Every time the visitors come to your site and click on the links web server writes these actions to the log file. Log file contains records about all web pages and graphic elements requested by the users. Log files are usually stored on the web server computer. You need to ask you ISP or hosting company how to get the raw log files for your website. On Unix hosting log files usually have names similar to access_log or
access_log.gz. On
Winsows/IIS hosting files usually are named like ex040423.log,
ex040424.log
.

This software can not analyze log files from other programs, like proxy server logs, etc. Deep Log Analyzer can access log files via ftp or read logs from your local drive if you have copied them from the web server computer. Deep Log Analyzer can read log files archived in zip or gz.

Where is the projects data actually stored on my hard drive?

I want to back it up/I want to move it to another folder or drive. Deep Log Analyzer keeps files for all projects inside one single directory. Exact location varies from computer to
computer and usually is "C:\Documents and Settings\All
Users.WINDOWS\Application Data\DLA Storage\"
.

To see where the Data Storage is located on your computer click File-Open menu and look at the bottom of the Open Project dialog. Projects are located in subfolders inside Data Storage directory. Each project folder contains hits.mdb file that is MS Access database containing imported log files. If it is not enough free space on the hard drive with the storage you may move it to another drive. Click File-Move Data Storage menu to do it. Deep Log Analyzer will copy all files to the new location you entered.

What kind of database does Deep Log Analyzer use?

Deep Log Analyzer imports web server log files into industry standard MS Access database. There is one separate mdb file for each project. Database file is name hits.mdb and located in project’s subdirectory inside Data Storage.

You can simply open database in MS Access using [File-Open Database in MS Access] menu command. Database is carefully designed according to normalizatio rules for speed- and size- efficient storage of web site log files data. To view database structure diagram click open diagram.jpg file located in Deep Log Analyzer
directory or click View Database Diagram in Start menu. You can design custom query in MS Access and create custom report in the program based on that query. Standard database format makes it easy to open the database in other programs where you needto access website statistical data.

How to have the program reports exclude such files as .cgi and .txt?
I basically just want .html and .htm pages. By including .cgi, etc it is throwing off my results.

You can do it. You need to edit some settings of your project manually asdescribed in this knowledgebase article

Is it possible to include our own company logo into the exported reports?

You can customize the look of the exported HTML reports.
Export is based on the template file located in

"C:\Program Files\Deep Log Analyzer\Templates\report.html"

First backup this file.
Open report.html in text editor and add your logo. Do not save this file
from WYSIWYG editors as it’s not true HTML file and they can break its structure.

It’s possibly better to link to your image located on the web,
so that it’s accessible from any place the report is opened.

You can also customize other details of the report look in this template.
For printing reports Deep Log Analyzer uses print.html file located in same folder.
It can be modified same way

Can I customize colors of the exported reports?

You may change the colors and other design aspects of the HTML reports.
Export is based on the template file located in

"C:\Program Files\Deep Log Analyzer\Templates\report.html"

First backup this file. Then open report.html in text editor. Do not save this file
from WYSIWYG editors as it’s not true HTML file and they can break its structure.

There is an XML section on top of the document between [$XML_BEG] and [$XML_END] tags.
All colors are defined there in XML format. There are colors defined for 3 levels of
hierarchical reports.

For example, to change table colors modify the following 2 values:

<TableLight>#f2fbfe</TableLight>

<TableDark>#d3f2ff</TableDark>

Purchase Questions

How much is Deep Log Analyzer?

Please look at our Buy Page for current prices. Licensing is based on the number of computers where program can be installed. Base license is for one computer. If your organization needs to install it on more computers and make it available for more users you need additional licenses.

We offer also volume discounts for multiple license purchases.
Click the ‘Volume Discounts Available’ link on product’s order form.

How can I buy Deep Log Analyzer software?

You can buy Deep Log Analyzer on our web site.
Orders are
processed by our partners Plimus, located in California, USA. They offer
a variety of payment options: MasterCard, Visa, EuroCard, American Express,
Discover/Novus, Diners Club, JCB, US$ Checks, Eurochecks, Wire Transfers.
Payments can be made Online, by Fax, by Mail or by Phone. Purchase orders are also accepted.

Please contact our sales department if you have any questions.

Can I buy Deep Log Analyzer with Purchase Order?

We accept purchase orders from the companies and organizations. We allow a payment deadline of 30 days from purchase. To order click Buy Now link on the online order page and select Purchase Order as your Method of payment. Follow the instructions and fax your purchase order to Plimus. Basically you will need to print out the Quote and send it together with your Purchase Order. Unfortunately, Purchase Orders received without the Quote will simply be discarded by Plimus without
further notice.

What happens after I purchase Deep Log Analyzer online?

After you pay you will instantly receive the download link for the fully functional product and your registration license code. Delivery is performed via email. Then you download and install full version of the program, enter registration code and activate the program online. After doing these easy steps you may start using the program.

Is there any hidden fees?

There is only one flat fee that you pay once and own the license for the product forever. There is no need to pay for subscription, tech support, etc.

Do I get technical support with my purchase?

As a registered user you get high priority product life time free technical support via email. Please contact us for with any questions.

How about the upgrades?

We work on improving our software constantly. Product updates and fixes are available quite often. Registered users get all upgrades for free during on year since purchase date. We send out emails with the upgrade instructions periodically. Upgrades after one year are available with large discounts.

I purchased your software with my credit card. What charge will I see in my credit card statement?

Please note that the charge on your credit card statement will appear as: PLI*DEEPSOFTWARE.
PLI is for Plimus that is Deep Software’s partner who is processing orders for our software