{5} Assigned, Active Tickets by Owner (Full Description) (20 matches)

I running Debian 3.1 and Spamassassin 3.1.7 I've installed the System full. When ich run the test, i get this error libstring-approx version 3.24-1 FuzzyOcr? 2.3b Any Idea ?

SFSPM077:/usr/src/FuzzyOcr-2.3b# spamassassin --debug FuzzyOcr? /root/Ham/ /dev/null [22805] warn: plugin: failed to parse plugin /etc/spamassassin/FuzzyOcr.pm: "adistr" is not exported by the String::Approx module [22805] warn: Can't continue after import errors at /etc/spamassassin/FuzzyOcr.pm line 52 [22805] warn: BEGIN failed--compilation aborted at /etc/spamassassin/FuzzyOcr.pm line 52. [22805] warn: plugin: failed to create instance of plugin FuzzyOcr?: Can't locate object method "new" via package "FuzzyOcr?" at (eval 192) line 1. [22805] info: config: failed to parse line, skipping: focr_verbose 1 [22805] info: config: failed to parse line, skipping: focr_logfile /etc/mail/spamassassin/FuzzyOcr.log [22805] info: config: failed to parse line, skipping: focr_global_wordlist /etc/mail/spamassassin/FuzzyOcr.words [22805] info: config: failed to parse line, skipping: focr_enable_image_hashing 2 [22805] info: config: failed to parse line, skipping: focr_digest_db /etc/mail/spamassassin/FuzzyOcr.hashdb [22805] info: config: failed to parse line, skipping: focr_hashing_learn_scanned 1 [22805] warn: rules: failed to run FUZZY_OCR_CORRUPT_IMG test, skipping: [22805] warn: (Can't locate object method "dummy_check" via package "Mail::SpamAssassin::PerMsgStatus?" at /usr/share/perl5/Mail/SpamAssassin/PerMsgStatus.pm line 2638. [22805] warn: ) [22805] warn: rules: failed to run FUZZY_OCR_WRONG_CTYPE test, skipping: [22805] warn: (Can't locate object method "dummy_check" via package "Mail::SpamAssassin::PerMsgStatus?" at /usr/share/perl5/Mail/SpamAssassin/PerMsgStatus.pm line 2638. [22805] warn: ) [22805] warn: rules: failed to run FUZZY_OCR_KNOWN_HASH test, skipping: [22805] warn: (Can't locate object method "dummy_check" via package "Mail::SpamAssassin::PerMsgStatus?" at /usr/share/perl5/Mail/SpamAssassin/PerMsgStatus.pm line 2638. [22805] warn: )

from time to time (no idea, what is the cause) many warnings are output stating a problem with one line in FuzzyOcr?.pm

/var/log/warn

Dec 27 09:37:41 mail5 spamd[7541]: Argument "/tmp/.spamassassin7541QKDwn2tmp/DSC01043.JPG.pnm:" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:37:41 mail5 spamd[7541]: Argument "PPM" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:37:41 mail5 spamd[7541]: Argument "raw," isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:37:41 mail5 spamd[7541]: Argument "by" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:16 mail5 spamd[8934]: Argument "/tmp/.spamassassin89343zrA9ctmp/DSC01043.JPG.pnm:" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:16 mail5 spamd[8934]: Argument "PPM" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:16 mail5 spamd[8934]: Argument "raw," isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:16 mail5 spamd[8934]: Argument "by" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:59 mail5 spamd[8934]: Argument "/tmp/.spamassassin89343zrA9ctmp/DSC01044.JPG.pnm:" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:59 mail5 spamd[8934]: Argument "PPM" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:59 mail5 spamd[8934]: Argument "raw," isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:38:59 mail5 spamd[8934]: Argument "by" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:39:33 mail5 spamd[8934]: Argument "/tmp/.spamassassin89343zrA9ctmp/DSC01042.JPG.pnm:" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:39:33 mail5 spamd[8934]: Argument "PPM" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:39:33 mail5 spamd[8934]: Argument "raw," isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.
Dec 27 09:39:33 mail5 spamd[8934]: Argument "by" isn't numeric in sprintf at /etc/mail/spamassassin/FuzzyOcr.pm line 617.

The same time the process list of the system is filling up by gocr processes. The only way to free the system again is to kill manually the gocr processes.

/etc/mail/spamassassin/FuzzyOcr.cf

#loadplugin FuzzyOcr FuzzyOcr.pm
body FUZZY_OCR eval:fuzzyocr_check()
describe FUZZY_OCR Mail contains an image with common spam text inside
body FUZZY_OCR_WRONG_CTYPE eval:dummy_check()
describe FUZZY_OCR_WRONG_CTYPE Mail contains an image with wrong content-type set
body FUZZY_OCR_CORRUPT_IMG eval:dummy_check()
describe FUZZY_OCR_CORRUPT_IMG Mail contains a corrupted image
body FUZZY_OCR_KNOWN_HASH eval:dummy_check()
describe FUZZY_OCR_KNOWN_HASH Mail contains an image with known hash

priority FUZZY_OCR             900

########### Plugin Configuration #############


#### Logging options #####

# Verbosity level (see manual) Attention: Don't set to 0, but to 0.0 for quiet operation, or comment out the focr_logfile line. (Default value: 1)

focr_verbose 2

# Logfile (make sure it is writable by the plugin) (Default value: NONE)

focr_logfile /var/log/FuzzyOcr.log


##### Wordlists #####
# Here we defined the words to scan for (Default value: /etc/mail/spamassassin/FuzzyOcr.words)
#focr_global_wordlist /etc/mail/spamassassin/FuzzyOcr.words
#
# This is the path RELATIVE to the respektive home directory for the personalized list
# This list is merged with the global word list on execution (Default value: .spamassassin/fuzzyocr.words)
# If focr_personal_wordlist begins with '/', treats option as fixed path and does not search HOME
#focr_personal_wordlist .spamassassin/fuzzyocr.words
#####################

# These parameters can be used to change other detection settings
# If you leave these commented out, the defaults will be used.
# Do not use " " around any parameters!
#
##### Location of helper applications (path + binary) (Default values: /usr/bin/<app>) #####
focr_bin_gifsicle /usr/local/bin/gifsicle
#focr_bin_giffix /usr/bin/giffix
#focr_bin_giftext /usr/bin/giftext
#focr_bin_gifinter /usr/bin/gifinter
#focr_bin_giftopnm /usr/bin/giftopnm
#focr_bin_jpegtopnm /usr/bin/jpegtopnm
#focr_bin_pngtopnm /usr/bin/pngtopnm
#focr_bin_bmptopnm /usr/bin/bmptopnm
#focr_bin_tifftopnm /usr/bin/tifftopnm
#focr_bin_ppmhist /usr/bin/ppmhist
focr_bin_gocr /usr/local/bin/gocr
#focr_bin_ocrad /usr/bin/ocrad
#
#focr_path_bin /usr/local/netpbm/bin:/usr/local/bin:/usr/bin
#
############################################################################################

##### Scansets, comma seperated (Default value: $gocr -i -, $gocr -l 180 -d 2 -i -) #####
# Each scanset consists of one or more commands which make text out of pnm input.
# Each scanset is run seperately on the PNM data, results are combined in scoring.
#focr_scansets $gocr -i $pfile, $gocr -l 180 -d 2 -i $pfile
#
# An example that involves ocrad as well
#focr_scansets $gocr -i $pfile, $gocr -l 180 -d 2 -i $pfile, $ocrad -s 0.5 -T 0.5 $pfile
#
# Another one for ocrad only
#focr_scansets $ocrad -s 0.5 -T 0.5 $pfile
#
# To use only one scan with default values, uncomment the next line instead
#focr_scansets $gocr -i $pfile
#
# Some example for more advanced sets
# Thisone uses the first the standard scan, then a scanset which first reduces the image to 3 colors and then scans it with custom settings
# and then it scans again only with these custom settings
# NOTE: This is for advanced users only, if you have questions how to use this, ask on the ML or on IRC, most times you wont need this at all
#focr_scansets $gocr -i $pfile, pnmnorm $pfile 2>$efile | pnmquant 3 2>>$efile | pnmnorm 2>>$efile | $gocr -l 180 -d 2 -i -, $gocr -l 180 -d 2 -i $pfile
#########################################################################################

##### Various Score/Scan settings #####
# Timeout for the plugin, in seconds. (Maximum runtime of the plugin) (Default value: 10)

#focr_timeout 15

#
# Default detection treshold (see manual) (Default value: 0.3) (Can be changed on a per word basis in the wordlist).
#focr_threshold 0.3
#
# This is the score for a hit after focr_counts_required matches
#focr_base_score 5
#
# This is the additional score for every additional match after focr_counts_required matches (Default value: 1)
#focr_add_score 0.375
#
# This is the score to give for a wrong content-type (e.g. JPEG image but content type says GIF) (Default value: 1.5)
#focr_wrongctype_score 1.5
#
# This is the score to give for a corrupted image (This currently affects only GIF images) (Default value: 2.5)
#focr_corrupt_score 2.5
#
# This is the score to give for a corrupted unfixable image (This currently affects only GIF images) (Default value: 5)
#focr_corrupt_unfixable_score 5
#
# This is used to disable the OCR engine if the message has already more points than this value (Default value: 10)

focr_autodisable_score 99

#
# Number of minimum matches before the rule scores (Default value: 2)
#focr_counts_required 3
#
#######################################

##### Image Hash Database settings (Recommended, but disabled by default) #####
#
# Set this to 2 to enable the Image Hash database feature (Default value: 0.0)
# Value = 1 ... use digest_hash only
# Value = 2 ... use digest_db w/digest_hash import (Recommended)
focr_enable_image_hashing 2
#
# The score is saved with the hash in the database, so no extra scoring for a db hit is required.
#
# If the image hash database feature is enabled, specify the file here to use as database
# (Default value: /etc/mail/spamassassin/FuzzyOcr.hashdb)
#focr_digest_db /etc/mail/spamassassin/FuzzyOcr.hashdb
#
# If the image hash db feature is enabled, specify the file here to use as database
# (Default value: /etc/mail/spamassassin/FuzzyOcr.db)
#focr_db_hash /etc/mail/spamassassin/FuzzyOcr.db
#
# If the image hash db feature is enabled, specify the file here to use as database
# (Default value: /etc/mail/spamassassin/FuzzyOcr.safe.db)
#focr_db_safe /etc/mail/spamassassin/FuzzyOcr.safe.db
#
# Expire records from focr_digest_db after (Default: 35) days
#focr_db_max_days 15
#
# Automatically add hashes of spam images recognized by OCR to the Image Hash database, to disable, set to 0.0 (Default value: 1)
#focr_hashing_learn_scanned 1
#
# Keep files that generate errors (Default: 0.0)
#  0 = always cleanup
#  1 = keep only if error
#  2 = always keep
#focr_keep_bad_images 0.0
#
# Score images who's global word count is below focr_counts_required using focr_add_score * word count as score.
focr_score_ham -0.5
######################################################################
mail5:/var/log #

I neglected to install libgif-utils on FC6, and so was missing giftext and giffix. FuzzyOCR's logs showed it trying to exec a string that was the concatenation of an empty $rcmd + the input filename, which resulted in

dbg: FuzzyOcr?: Exec : /tmp/.spamassassin5733JVhP4Ptmp/CIMG0980.gif

which seems like a very bad thing!

I believe the root cause of this is FuzzyOcr?.pm line 406. It looks like the code there is trying to guard the following code, i.e. "if any of these programs are missing, go to the next file". Unfortunately, the scope of the "next" is referring to is the foreach, not the main file loop, and so it remains possible to use undefined values in the subsequent code.

(This is FuzzyOcr?.pm from the svn trunk)

Using the svn version w/ SA 3.2.2 I see these errors on not all images but a decent amount of them. I do not have pdf processing enabled. The best I can tell is a file claiming to be an image but really a pdf or something? What do you need from me in order to fix this?

Oct 10 15:36:13 a spamd[25889]: prefork: child states: BIBIBBIIIII 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in concatenation (.) or string at /etc/mail/spamassassin/FuzzyOcr.pm line 382. 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in concatenation (.) or string at /etc/mail/spamassassin/FuzzyOcr.pm line 383. 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in pattern match (m//) at /etc/mail/spamassassin/FuzzyOcr.pm line 396. 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in pattern match (m//) at /etc/mail/spamassassin/FuzzyOcr.pm line 400. 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in concatenation (.) or string at /etc/mail/spamassassin/FuzzyOcr.pm line 406. 
Oct 10 15:36:13 a spamd[20091]: Use of uninitialized value in concatenation (.) or string at /etc/mail/spamassassin/FuzzyOcr.pm line 722. 
Oct 10 15:36:13 a spamd[20091]: FuzzyOcr: Cannot exec pdftops, skipping image 
Oct 10 15:36:13 a spamd[20091]: FuzzyOcr: Cannot exec pstopnm, skipping image 
Oct 10 15:36:13 a spamd[20091]: FuzzyOcr: Cannot exec pdfinfo, skipping image 

This problem is not directly with Fuzzy OCR, but I thought this would be a good place to ask my question. I have installed gocr, ocrad and tesseract-ocr and none of these applications will process my spam images. These images are the typical Viagra/pill spam messages that have only a gif image and a bunch of random text. The problem is the orientation of the image. The image is skewed at an angle on a white background. When I run it through any of these ocr apps, I get a bunch of garbage as output. I am assuming that this is because of the angle of the image. Has anyone run into this type of image?

Also, I did not know if it would be appropriate to attach the image, so I did not. Please let me know if anyone would like a sample image, so they can see what I am talking about.

Thanks, Brian

Under certain conditions (that I have yet to discover) the temp directories created in /tmp are not getting deleted when FuzzyOcr? is done with its scans. This happens both with the 3.4.2 devel release and the 3.4.3 version of FuzzyOcr?.pm from the Source tree. The following are examples of successful deletion entries in the logfile and unsuccessful:

2006-12-05 15:34:58 [81691] Saved: /tmp/.spamassassin81691t9BsTytmp/raw.eml
2006-12-05 15:34:58 [81691] Wrote: /tmp/.spamassassin81691t9BsTytmp/be.png
2006-12-05 15:34:58 [81691] Errors to: /tmp/.spamassassin81691t9BsTytmp/raw.err
2006-12-05 15:34:58 [81691] pfile => /tmp/.spamassassin81691t9BsTytmp/be.png.pnm
2006-12-05 15:34:58 [81691] efile => /tmp/.spamassassin81691t9BsTytmp/be.png.err
2006-12-05 15:34:58 [81691] Calculating the image hash: /tmp/.spamassassin81691t9BsTytmp/be.png.pnm
2006-12-05 15:35:09 [81691] Remove DIR: /tmp/.spamassassin81691t9BsTytmp

2006-12-05 15:32:45 [81691] Saved: /tmp/.spamassassin81691MhW8rEtmp/raw.eml
2006-12-05 15:32:45 [81691] Wrote: /tmp/.spamassassin81691MhW8rEtmp/moiety.gif
2006-12-05 15:32:45 [81691] Errors to: /tmp/.spamassassin81691MhW8rEtmp/raw.err
2006-12-05 15:32:45 [81691] pfile => /tmp/.spamassassin81691MhW8rEtmp/moiety.gif.pnm
2006-12-05 15:32:45 [81691] efile => /tmp/.spamassassin81691MhW8rEtmp/moiety.gif.err
2006-12-05 15:32:45 [81691] Calculating the image hash: /tmp/.spamassassin81691MhW8rEtmp/moiety.gif.pnm

As seen the last message I receive regarding the files in that directory are that they are being scanned. No scan error messages are getting logged for these files.

I just received some image spam which FUZZY_OCR helped catch. However, the FUZZY_OCR_WRONG_EXTENSION rule triggered when it shouldn't have (if it was attempting to do what I think it was).

Amongst other things, SA reported

1.5 FUZZY_OCR_WRONG_EXTENSION BODY: Mail contains an image with wrong

file extension Image has format "GIF" but file extension is "com"

The GIF file was defined by the following MIME component:

--0-1631692137-1169001736=:54847 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Id: <3603334256000001@web39602.mail.mud.yahoo.com>

R0lGODdhLgGYAecAAP///+fv/NHj+uLl4Pb3/LbTu4TA7LK68ajX+PL36cbS

As you can see - there is no filename definition. So therefore FUZZY_OCR_WRONG_EXTENSION shouldn't have triggered?

Other than that, FuzzyOCR clicks spam out the door! ;-)

Thanks

Jason

The FuzzyOcr? descriptions all appear as

1.5 FUZZY_OCR_WRONG_CTYPE BODY: 1.5 FUZZY_OCR_WRONG_EXTENSION BODY: 2.5 FUZZY_OCR_CORRUPT_IMG BODY:

13 FUZZY_OCR BODY:

This may be a SpamAssassin? bug: I can't see anything wrong with the describe lines in FuzzyOcr?.cf.

Is this normal behavior? giftext[24236]: segfault at 0000000000000000 rip 0000000000401316 rsp 0000007fbffffc00 error 4 giffix[24237]: segfault at 0000000000000000 rip 00000000004011b7 rsp 0000007fbffffc60 error 4

If not how do I fix it?

Thanks

hello, I am not sure that is rigth place for this question. If no please direct me...

I installed fuzzy 3.5 and all requirments. when I try to work with sample mails it detects as a spam (very high score). But when i send an email from my client (include image) it's written to log like this:

2006-12-21 17:42:28 [15416] Processing Message with ID "<E1GxQ21-0002RE-WA@spam69.doruk.net.tr>" (Nazım Avcı <nazim@doruk.net.tr> -> 'Nazım Avcı' <nazim@doruk.net.tr>) 2006-12-21 17:42:28 [15416] Skipping OCR, no image files found... 2006-12-21 17:42:28 [15416] Processed in 0.001410 sec.

what is the problem? thanks

Nazım