NxFilter 4.3.8.9 + Portable

- Unset Alert Categories at default.
- Use 'block_public_ip' option when it's actually set.
- Baselist has been updated to 3740797.

- Max file size for a blocklist has been increased to 30MB.
- Block by request type before attack domain detection.
- Baselist has been updated to 3727033.

'/nxfilter/conf/system-block.txt' added for System Block Domains.
Baselist has been updated to 3694015.

- Baselist has been updated to 3641806.

NxClassifier.parseMetaRefresh bug fixed.
NxClassifier ruleset has been updated to 442-2.
Set retry count to 1 in for ResolverMan.
Ignore additional records for Response.updateAnswerTtl().
Baselist has been updated to 3570601.
Cache refresh for every DNS request bug has been fixed.

Timeout for DNS connection will be set inside ResolverMan.createResolver.
Category name check on JahaslistDic.find.
Password size limit has been increased to 128.
Baselist has been updated to 3477079.

- Write domain, user, client IP counts by logAll data.
- Add default policyId and a new token for the new user by login request
  approval.
- Config.start_time has been added.
- Negative cache will be applied on IPv6 response.
- Baselist has been updated to 3335847.
- Display uptime on 'Report > Usage'.
- Set true to 'drop_attack_request_by_domain', 'drop_attack_request_by_ip'
  at default.

NxClassifier ruleset updated to 440-5.
Globlist supports up to 5 policies.
Baselist has been updated to 3179377.

Trim the result of Config.getHostname.
Answer 'use-application-dns.net' with NXDOMAIN.
Jahaslist has been updated to 3086091.

Validation check for '|)' for classifier rule.
NxClassifier ruleset updated to 440-3.
Wait 2 seconds for graceful shutdown on LocalListener.
Increase ruleset modification count when it's through GUI.
Add Local DNS and Local Domain into NxClient policy.
NxLocal support added.
Uppercases allowed on LDAP setup.
'/LNZ' protocol added for CxBlock.
'ldap.admin' column size increased to 256.
'-' allowed in group name.
Jahaslist has been updated to 2730651.

Extract domain from URL on Domain > Test.
v4.3.2.7 of 'domain-pattern.txt' applied.
NxClassifier ruleset updated to 439.
Use LocalTalkie.clearJahasDicCache() on DAO classes.
Jahaslist has been updated to 2443476.

SafeCache related changes rolled back.

Possible null pointer exception bug from MsgUtil.RecordArrayToString fixed.
Process 'Bypass All' after local resolver forwarding.
Null data permitted into persistent_cache.authority_arr column.
Persistent cache not adding with Minimum Responses enabled bug fixed.
SafeSearchCache class replacing RespCache for safe-search forward.
Safe-search forward for IPv6 added.
EDNS identifier verification enabled.

JSP pages with 'noacl,' prefix will be regarded as user pages.
Config.bypassEmptyDomain flag removed.
Use LocalListener.loginMd5 on UserLoginDao.login.
UTF-8 encoding applied on net.Talkie and net.Listener.
'/CXB' protocol for base64 encoded username from CxLogon added.
Redirection only works for A type query.
Fix truncate table bug from v4.1.1 update.
Create 'persistent_cache' table only if not exists on 4280 update.
'startsWith' check for Global.NSLOOKUP_DOMAIN on request handler.
'startsWith' check for Global.BLOCK_DOMAIN on request handler.

Thread pool applied on UDP client connection.
Global.BLACKLIST_TYPE_NONE has been removed.
Request.isUnsupportedProtocol flag has been removed.
Jahaslist has been updated to 2352337.
Bind on listenIP for DnsListener, HxListener, WebSocketHandler.
Clean up additional section for relay signal.
Listner for DNS over SSL enabled.
Add one more NxError for NxRelay client IP.

Classifier.DomainQueue.size returns domainList.size.
HtmlPatternDetector has been disabled.
JahasUpdate().copyRulesetToSlaveLocalDb() added.
NxClassifier ruleset updated to 438.
Jahaslist has been updated to 2319531.

Maximum subdomain chopping count on JahasDic.findId adjusted to 5.
Duplicated token check on UserDao added.
User policy overrides group policy.
Redundant 'catnameLine' and 'grpLine' have been removed from making unique keyword for logging.
Active Directory integration over cloud with NxRelay added.

200 milliseconds delay for '/IBR' protocol added.
'/PING' protocol added on HxListener.
Remove 'Top User', 'Top Client IP' charts from user report.
V4.2.4 of 'domain-pattern.txt' applied.
Jahaslist has been updated to 2107631.
NxClassifier ruleset updated to 420.1.
VxLogon protocol bug with '.' in username fixed.

Description field added on whitelist properties
HxListener added
DomainPatternDic enabled on Globlist
'Proxy Filtering' -> 'Remote Filtering' on GUI
Windows installer to keep '/nxfilter/bin/startupbat'
Deb package to keep '/nxfilter/bin/startupsh'
'/nxfilter/bin/417-*bat' scripts removed
v422 of 'domain-patterntxt' applied
Jahaslist has been updated to 2005709
NxClassifier ruleset updated to 420
'category_jahas' not populated bug fixed

NxClassifier.getDbJahaslist bug fixed

Globlist added.
LoginListener.dealHostLogout added.
'Web Hosting' category separation enabled.
NxClassifier ruleset updated to v4.2.0.
Don't send license expiration email in trial period.
Biglist update disabled.
Duplicated 'classifier_ruleset' loading message removed.
Don't add an invalid request into request queue.

p2, v4.1.8 of 'domain-pattern.txt' applied.
p2, Jahaslist has been updated to 1771263.

- DomainDic.isBotnetDomainByConsonantCount added.
- Creating domain_unclass table only if it doesn't exist.
- NxClassifier ruleset updated to v4.1.8.
- Default memory allocation increased to 768 MB.
- New Windows service wrapper applied.
- VxLogon support added.
- Don't increase domain test count on dealAskDomainCatid.
- Jahaslist has been updated to 1722042.
- p1, Config.resetAcl table name bug fixed.
- p1, lib.css updated to 418.1.

- DomainDic.isBotnetDomainByConsonantCount added.
- Creating domain_unclass table only if it doesn't exist.
- NxClassifier ruleset updated to v4.1.8.
- Default memory allocation increased to 768 MB.
- New Windows service wrapper applied.
- VxLogon support added.
- Don't increase domain test count on dealAskDomainCatid.
- Jahaslist has been updated to 1722042.

- Threshold for unclassifed report decreased to 10.
- Local NxClassifier.mcIdx hiding global one removed.
- Recategorization request started on 105 points.
- 'Web Hosting' category readded on Jahaslist.
- NxClassifier ruleset updated to 416.
- v4.1.5 of 'domain-pattern.txt' applied.
- User-agent string updated for NxClassifier.
- Typo corrected on categories.txt, 'IIlegal' -> 'Iilegal'.
- Only show search result on 'NxClassifier > Jahaslist'.
- Jahaslist has been updated to 1588849.

News -> News/Magazine on Jahaslist category.
Don't report unclassified domains when JahasDic bypassing.
Redundancy validity check for DomainDic.doesDomainExist removed.
Bypass all by client IP on 'Config > Allowed IP' added.
Jahaslist has been updated to 1550327.
CategoryDic unsynchronized.
Custom classified domain export/import added on 'Category > System'.

p1, Bug with 'Bypassing by client IP' fixed.
p1, ZoneLookup bug fixed.

- DomainDic.doesDomainExist only checks NX domain.
- Default value for classifier_setup.keep_html_text set to be 'TRUE'.
- Bypass NxClassifier.recat when Jahaslist update disabled.
- Custom category selection possible on recategorization from
'Logging > Request'.
- Tutorial link in 'tutorial.bat' fixed.
- 1.4 million domains added into 'baselist.txt'.
- Import new domain only when it does biglist update.

'NxClassifier > Setup > Mass Import' has been removed.
'REPLACE' button added on 'NxClassifer > Ruleset'.
'IMPORT' button added on 'NxClassifer > Jahaslist'.
eDirectory support added.
Reclassify immediately when it is from NxClassifier.
Syslog prefix not converted to upppercase bug fixed.
Bypass RecatMan.recat for invalid domains.
Log retention days can be set to 0.
Possible NullPointerException in JahasUpdate.addBigList removed.

- ClassifiedData.getCtime format restored to 'MM/dd HH:mm'.
- login.css has been removed.
- v1.1 of 'domain-pattern.txt' applied.
- NxClassifier ruleset updated to 385.
- ClassifierRulsetDao.updateRulesetOld removed.
- classifier_ruleset.update_count column removed on a new installation.
- 'score' added on 'recat' table.

- Cache DB connection not released bug on Main.delete_old fixed.
- Charset extraction regex pattern on NxClassifier updated.
- New domain pattern dictionary from v4 added.
- Auto-update for biglist for Jahaslist added.
- New ruleset for NxClassifier having 375 rules.
- Main.LdapUpdaterRestarter class added.
- Lazy loading for LogCache.domain restored to pre-loading.
- LogCache.find has been unsynchronized.

- Cache DB connection not relased bug on Main.delete_old fixed.
- Charset extraction regex pattern on NxClassifier updated.
- New domain pattern dictionary from v4 added.
- Auto-update for biglist for Jahaslist added.
- New ruleset for NxClassifier having 375 rules.
- Main.LdapUpdaterRestarter class added.

LDAP over SSL support added
LogWriter.flush before making report cache and delete old data
Apply 'Alert Category' option on domains blocked as 'Adware'
Add host IP on queue full alert email
Safe-search has been applied on 'youtube.googleapis.com'
LookupHandler not refreshing safe-search domain cache bug fixed
Safe-search to be working only for 'A' type DNS query
Google safe-search redirection will only be applied on its 'www'
and 'encrypted' subdomain
Global.Nx_DOWNLOAD link has been updated
Safe-search mode on policy has been introduced
Default value for 'max_slave_num' has been increased to 8

LogWriter waits for flusing until traffic DB unlocked.
Not able to set 'classifier_num' to 0 bug has been fixed.
Jahaslist updated to 378336.
NxClassifier ruleset updated to 381.
Duplicated domain in 'domain_classified' table bug fixed.

Minimum TTL for safe-search domain and domain to domain response introduced.
To read alert email template as a regular text file on AlertMan.
CC recipients added for alert email.
Bypass nightly report generating on a slave node.
Return on invalid message for WebSocketHandler.onTextMessage.
NxForward support added.
'Disable Default Repository' option added on 'NxClassifier > Setup'.

Not refreshing expired CNAME cache on LookupHandler bug fixed.
CSV log exportation limit incresed to 100,000.
'common_edge.css' has been removed.
PrefixDic is not a Thread anymore.
'alert' package added.
Path not allowed in IE proxy bypass.

'drop_empty_response' option added on cfg.properties.
NodeTalkie doesn't try to connect when master node down.
BlockPage gets a default NxError when master node down.
Login to slave GUI when master node down allowed.
Interval for finding the last error on BlockDao adjusted to 50.
LogWriter flush interval to master node adjusted to 5 seconds.

Redundant bootstrap directory has been removed.
We don't load data on DynUpdate when we find a blank domain.
License file sharing between cluster nodes bug fixed.

- Improved DataBase, RowSet classes applied.
- BlockDomainResolver returns '127.0.0.1' when there is no block
redirection IP loaded on a slave node.
- Filtering still works on a slave node having master node down.
- Blacklist license update on GUI added.
- License policy changed.
- New authoritative DNS server module applied.
- URLBlacklist support has been removed.

New domain validation function applied for allowing the domains not having dot.
Support for NxUpdate v1.x, NxClient v1.x stopped.
Using standard DNS protocol for NxUpdate and NxClient signals and queries.
Send error message to NxClient when authentication disabled.
Remove duplicated username on the dropdown list on 'Report > Daily'.
Keep LDAP DN for an LDAP imported user for LDAP login.
'nxd.ldap' package added.
Add auth_drop_cnt instead of auth_redi_cnt when authentication not enabled.
Set 'false' for 'follow_referral' on LDAP login.
Version query signal added.
Cache DNS response only when it has at least one A record.
Removed redundancy checking for empty message from response cache.
UTF-8 support for Jahaslist remote repository text file.
Not sending DNS response after caching bug from v3.3.0 fixed.
LDAP import excluded keyword size increased to 2,000 bytes.

- New domain validation function applied for allowing the domains
not having dot.
- Support for NxUpdate v1.x, NxClient v1.x stopped.
- Using standard DNS protocol for NxUpdate and NxClient signals and
queries.
- Send error message to NxClient when authentication disabled.
- Remove duplicated username on the dropdown list on 'Report > Daily'.
- Keep LDAP DN for an LDAP imported user for LDAP login.
- 'nxd.ldap' package added.
- Add auth_drop_cnt instead of auth_redi_cnt when authentication not
enabled.
- Set 'false' for 'follow_referral' on LDAP login.
- Version query signal added.
- Cache DNS response only when it has at least one A record.
- Removed redundancy checking for empty message from response cache.
- UTF-8 support for Jahaslist remote repository text file.

- NxClassifier ruleset type for HTML text added.
- 'Keep HTML Text' option added on 'NxClassifier > Setup'.
- Domain validation for whitelist has been removed.
- Drop packet when there is a response message having no record from
an upstream server.

Error message for upstream DNS query timeout added.
DnsStats class added.
Updating Jahaslist through remote repository added.
Importing Jahaslist uses lesser memory.

- 'HTTP_RECAT_MAX_LINE' has been increased to 100000.
- Don't merge custom classified domains when it's not on Jahaslist.
- Remote update for NxClassifier ruleset disabled.
- 'IMPORT RULESET' on 'NxClassifier > Setup' changed to 'REPLACE RULESET'.
- Jahaslist can be updated without any existing data.
- 'recatlist.txt' in '/nxfilter/jahaslist'has been removed.
- Use 'img/pix.png' to express a horizontal line on GUI.
- Reading file line by line when it imports Jahaslist.
- 'Web Hosting' category added on Komodia mapping.
- Systemd auto-start script added on 'deb' package.
- 'Disable Auto Update' on 'NxClassifier > Setup' removed.
- 'Enable Auto Update' on 'NxClassifier > Setup' added.

- Set host IP only once for Syslog setup with system startup.
- Checking for empty DNS answer from cache added.
- 'Log Retention Days' length limit on GUI increased to 3.
- Separator for 'Slave IP' on 'config,cluster.jsp' changed to a comma.

- Response cache returns null when it's type A record bug fixed.
- New TTL calculation with the elapsed time bug in response cache fixed.
- Google safe-search domain not updated on response cache bug fixed.

Use get_real_uname, instead of accessing real_uname directly.
'Log retention days' increased to 400.
System domains bypassed for proxy filtering.
Waiting for the block reason populated for 100 milliseconds.
Lib.system_output gets string array as its parameter.

- Bypassing Active Directory domain to MS DNS server for unauthenticated
users.
- 'Follow Referral' option added for Active Directory importation.
- '#{nx_name}' not populated on 'block,chrome.jsp' bug fixed.
- Active Directory DNS bypassing comes before zone file search.
- Zone trasfer search comes after zone file search.
- Zone Transfer option on Active Directory importation removed.
- New algorithm for caculating the remaining TTL of a cached record to setup
the TTL for each record separately.
- 'bypass_cache_domain_list' param removed from cfg.propertis.

- Dynamic domain loaded with zero mtime bug fixed.
- Shallalist not including 'education/schools' bug fixed.
- Report on domain, user, client IP number missing bug fixed.

- Dynamic DNS support added.
- Whitelist applied on safe-search.
- Delete temporary zone files nightly.
- Warning message for not enabling authentication on IP association
to user.

- 'clt_cache_ttl' column moved into 'dns_setup' table

gob.xx' classified into government category.
Authority DNS server feature added.
DNS setup menu on GUI separated.
Different CSS applied on MS browser.
Wildcard lookup allowed on zone transfer.
ypass DNS query against '*.ip6.arpa '.
'block-time' on policy not reset bug fixed.
'clt_cache_ttl' column moved into 'dns_setup' table.

Minimum idle connection for DB pool changed to 10.
Maximum idle connection for DB pool changed to 30.
Sorting whitelist domains for NxClient.
Remote update for Jahaslist when NxFilter starts.
Bypass remote update when there's no data in Jahaslist.
Possible connection leak from RecatMan fixed.
Delete recategorization data before submitting.

Safe-search redirection applied to 'youtubei.googleapis.com' and 'www.youtube-nocookie.com'.
Auto-update for NxClassifer ruleset added.
Update count for NxClassifer ruleset introduced for auto-update.
Policy based block-time added.

Safe-search redirection applied to 'm.youtube.com'.
Jahaslist auto-update disabled when domain pattern dictionary disabled.
Case sensitivity problem with username for bandwidth control fixed.
Bandwidth control, 2000MB for a user limit removed.

HTML code input on 'GET/POST' requests blocked for preventing 'CSRF' attack.
javascript error for deleting custom categories fixed.
Alert categories added on 'Config > Alert'.

Remote Jahaslist recategorization list update added.
DomainPatternDic updated.
1,000 user limit for user selectbox on report removed.
RESTORE-DEFAULT' button added on 'NxClassifier > Ruleset' and 'NxClassifier > Jahaslist'
Unclassified domain cache removed.
Remove admin session data when admin logout.
admin.jsp?action=logout -> admin.jsp?action_flag=logout.
On log-view, hovering on category will show all the categories if there are multiple categories.

- Domain process queue size for NxClassifier adjusted to 10000.
- Internal lookup_map size for domain process queue of NxClassifier adjusted
to 1000.
- SQL error for 'is_already_classified()' fixed.

- ShallaUpdate, BlacklistUpdate classes moved into 'nxd.util' package.
- Remove 'www.' from reclassification reqest.
- Jahaslist added.
- Auto-classification by NxClassifier added.
- Multi-bytes character support for block-page added.
- 'TEST' button added for alert email setup.
- Use ParamTest instead of ParamValidator.
- Ciphers defined for Tomcat to solve 'ERR_SSL_WEAK_SERVER_EPHEMERAL_DH_KEY'
error on Chrome.

- New responsive login form template added.
- 'webapps/lib/jquery-1.11.3.min.js' added.
- 'webapps/lib/jquery.cookie.js' added.
- 'webapps/lib/bootstrap.min.css' added.
- CSS and javascript file inclusion moved into 'top.jsp'.
- Preview script on 'Config > Block Page' changed to use 'document.write()'.

- Keep logging for request IP address for admin login.
- New parsing algorithm for DomainPatternDic added.
- Tracker domain separated from Ads domain for DomainPatternDic.
- Missing data sanitization on WhitelistDao.update() added.
- Only one category for a custom categorized domain allowed.
- Domain reclassification popup on log-view added.
- Bypass LDAP synch when there's read timeout error.
- AutoCloseable DataBase and RowSet classes added.

- Recategorization request criteria activated.
- Log data not showing bug when you update from pre-v2.6.6 fixed.
- Block page size limit increased to 100 KB on validation.
- 'oem.properties' introduced.
- Update notification via alert email added.
- 'alert_email.ftl' template added.
- CNAME caching bug for safe-search fixed.

Block page size limit increased to 10 KB.
Bypassing 'Client Cache TTL' not working bug fixed.
Response cache applied on DNS response having additional section.
Use is_cached_once() instead of find() on DomainDic.
'moment.js' library removed from loggin,*.jsp pages.

- 'EDIT' on 'Category > System' changed to 'ADD-DOMAIN'.
- Tomcat compilerSourceVM and compilerTargetVM set to 1.7.
- UserTestDao.find_user() method restored.

- PhishDao removed.
- DaoUtil introduced for simplifying GUI customization.
- 'use_phishtank' field from ConfigData removed.
- Domain validation blocking for IDN bug fixed.
- Single category preference applied for 'Download'.
- Use 'ParamValidator.ERR_USERNAME_CHAR' for username checking.
- Ambiguous action target bug for 'category,system.jsp' fixed.
- has_new_message() and get_popup() methods have been removed from
AdminLoginDao.
- javascript date calculation bug on report fixed.

Local domain excluded from Komodia query.
Komodia query cache retention period increased to 7 days.
Table name 'cache' changed to 'komodia'.
Goverment category comes first when there are multi-categories for
Komodia mapping.
Special domain detection function added for Komodia.
Single category preference applied for Home/Gardening.
Remove 'www' for Komodia query.
Adding domain into system category became possible.
Duplicated map data for traffic DB on cluster bug fixed.
'/nxfilter/conf/prefix.txt' added for dynamic classification.
'/nxfilter/conf/suffix.txt' added for dynamic classification.
Datetime picker not selecting the days of last month bug fixed.
Database connection hang on 'Policy > policy' problem fixed.
CategoryData.get_domain_list() method for lazy loading added.
'moment.js' library removed.

Adding domain into system category became possible.
Dynamic classification based on domain pattern applied for Shallalist.
Duplicated map data for traffic DB on cluster bug fixed.

Special domain detection function added for Komodia.
Single category preference applied for 'Home/Gardening'.
Remove 'www' for Komodia query.
User IP listing format applied.

DynUpdate host checking obsoleted.
Local domain excluded from Komodia query.
Komodia query cache retention period increased to 7 days.
Table name 'cache' changed to 'komodia'.
Goverment category comes first when there are multi-categories for Komodia mapping.

IPv6 redirection IP setup added.
prunsrv.exe updated to v1.0.15.
Zone transfer checkbox removed from new Active Directory importation setup.
First login check for login through NodeListener.
Bypass filtering for queue full error on slave node.
Bypass domain existence checking for queue full error.

'no_share_session' option for cfg.properties added.
'Max domain length check' on policy bypassed at default.
'Block covert channel' on policy is off at default.
'Block mailer worm' on policy is off at default.
'Block DNS rebinding' on policy is off at default.

Pre-cache bug with CNAME record fixed.

- Dropdown menu added.
- config,config.jsp -> config,setup.jsp.
- main,dashboard.jsp -> dashboard.jsp.
- CSS validated.
- /conf/komodia.map updated to fix some type.

'show_netflow' option for cfg.properties added.
Daily trend chart interval corrected to 3600.
User traffic trend duplicated in report_cache bug fixed.
User traffic trend only 23 hours display bug fixed.
Domain, user, client-ip count on weekly report to show MAX value.
'chart3div' tag removed from report GUI.
Minimum response cache size increased to 100,000.
Maximum response cache size increased to 2000,000.
Reset whitelist when it lose the last parent policy.
chk_new_message() not to add blank line.
Well known site list size increased to 100,000.

Null data return for daily report bug fixed.
Single category only for Komodia categories applied.

- Custom category domain limit increased to 100,000.
- daily_stats table added.
- request_traffic_5m, request_traffic_1h, real_user_count removed.
- 'syslog_only' flag added into cfg.properties.
- Authentication error with LDAP username having space allowed.
- Default data for empty trend chart added.
- LibDate.strftime_arr bug fixed.
- log_view, signal_view, netflow_view, hh24, category_count_5m removed.
- Daily report and weekly report being generated based on start date.
- Datetime picker added for log-view and report.
- Report caching structure redesigned.
- Delete old data on 02:00.
- Generating report cache for daily, weekly report on 03:00.
- 'stop_auto_report' option for cfg.properties added.
- 'ldap_conn_timeout' option for cfg.properties added.
- 'ldap_read_timeout' option for cfg.properties added.
- Swimsuit/Underwear category on Komodia map merged into Fashion/Beauty.
- h2-1.3.176.jar added.

'log_flush_limit' option for cfg.properties added.
Komodia query only for existing domain.
'most_permissive' option for cfg.properties for multi-category permit.
MIN_TTL set to 5 seconds for a response cache.

- DB_CLOSE_ON_EXIT=FALSE added in JDBC URL.
- cluster_monitor missing colummn bug fixed.
- Phishing related option for cfg.properties removed.
- report_server_ip option for cfg.properties for separating reporting
DB added.
- Komodia 'Misc' mapping bug fixed.

- Syslog format changed to have 'NXFILTER' prefix.
- ShallalistUpdate to be using system DNS.
- Downloading the backup file from 'Config > backup'.

- License share between cluster nodes added.
- keystore_file, keystore_pass option added on cfg.properties for
custom SSL certification.
- Multi-level domain chopping with Shallalist bug fixed.

- alert_email.ftl removed.
- Komodia dynamic classification not added into cache.
- Most specific IP range comes first rule for user association added.
- '/conf/komodia.map' updated to having 69 categories.