5

Many of the authors I read, enjoy placing curse words in their books but use them a bit judiciously. In addition, I am not a fan of cursing in general.

I am currently filtering out curse words using Calibre, but it's not working terribly great. Some curse words are not caught due to their being capitalized, hyphenated, punctuated, etc. Other non-cuss words get filtered out when they don't need to be: Christian to ******ian.

Perhaps there is a preformatted list of cuss words available which I can import into Calibre and use as a filter?

2 Answers 2

12

What you're experiencing is also known as the "Scunthorpe problem", which is caused by wordfilters going haywire. To make a long story short:

Wordfilters do not work. They never did and never will.

If you actually want to remove cursing from any text, you're looking at a major programming task. There is no short-cut approach that actually works. It needs a substantial amount of code to semantically analyse every sentence in its context to find out if "cock" actually refers to a male chicken.

If cursing bothers you so much, I truely suggest picking your authors accordingly. There are tons of good authors out there who don't make judicious use of curse words. I assume there are more people bothered by this so there should be bloggers, forums etc. around giving recommendations.

P.S. I find it funny that you seem to have "Christ" on your filter list.

3
  • I'm not sure if it will "never" be solved. I'm confident eventually we will have artificial intelligence that will identify these sorts of things just as intelligently as a human. One of the authors I was reading used Christ as a curse quite a bit.
    – Aaron Klap
    Commented Feb 18, 2014 at 4:29
  • 1
    The term "wordfilter" refers to a type of algorithm (hence the Wikipedia link). That type of algorithm will actually never ever be able to solve your problem. That does not mean there are no (or never will be) other systems to get there.
    – Hazzit
    Commented Feb 19, 2014 at 3:25
  • Hmm... it seems that the Scunthorpe problem could be solved by using word barriers... of course, that wouldn't solve the 'cock-as-male-chicken' problem. I don't know if Calibre has this ability, though.
    – evilsoup
    Commented Feb 20, 2014 at 13:02
2

I had the same problem and created a plugin to do just this. See https://github.com/jdanders/calibre-plugin-language-cleaner/releases

1
  • Thank you very much for this. Was struggling with creating a search/replace filter set to remember to load everytime. This plugin seems to handle it correctly. Great job.
    – klkitchens
    Commented Feb 23, 2018 at 5:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.