JRuby

RedCloth failure with UTF-8

Details

  • Type: Bug Bug
  • Status: Open Open
  • Priority: Major Major
  • Resolution: Unresolved
  • Affects Version/s: JRuby 1.4
  • Fix Version/s: None
  • Component/s: Application Error
  • Labels:
    None
  • Environment:
    Gentoo Linux system with JRuby 1.4.0-r1
  • Number of attachments :
    0

Description

RedCloth from git (take the branch at http://github.com/Flameeyes/redcloth/tree/4cb38f2a99989f4f2c2ff60aa94174257b9eb5c4 — this commit is safe) fails when using UTF-8 characters.

Easy way to test:

% jruby -S rake compile
% jruby -I lib -rredcloth -e 'puts RedCloth.new("Français").to_html'
<p>Fran</p>

I guess the bug might very well be on the Ragel parser to be honest, but I'm afraid I'm no good at finding that out.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Charles Oliver Nutter added a comment -

Which version of Ragel did you use to discover this?

Show
Charles Oliver Nutter added a comment - Which version of Ragel did you use to discover this?
Hide
Permalink
Charles Oliver Nutter added a comment -

This definitely appears to be a bug in the RedCloth parser/scanner/whatever. I can see that the string gets into JRuby correctly.

Does it look like anyone's maintaining RedCloth right now? Does this work correctly on MRI?

Show
Charles Oliver Nutter added a comment - This definitely appears to be a bug in the RedCloth parser/scanner/whatever. I can see that the string gets into JRuby correctly. Does it look like anyone's maintaining RedCloth right now? Does this work correctly on MRI?
Hide
Permalink
Ola Bini added a comment -

I took a cursory glance at this, seeing as that RedCloth code was mine originally. I couldn't see any obviously wrong actually, but I'll take a deeper look next week (am on a project this week).

It works correctly in MRI.

Show
Ola Bini added a comment - I took a cursory glance at this, seeing as that RedCloth code was mine originally. I couldn't see any obviously wrong actually, but I'll take a deeper look next week (am on a project this week). It works correctly in MRI.
Hide
Permalink
Diego Elio Pettenò added a comment -

Ragel version is 6.6 (latest from upstream — incidentally I'm Gentoo's maintainer for Ragel ).

Show
Diego Elio Pettenò added a comment - Ragel version is 6.6 (latest from upstream — incidentally I'm Gentoo's maintainer for Ragel ).
Hide
Permalink
Ola Bini added a comment -

This definitely looks like a bug in ragel, but I haven't been able to narrow it down at all - it only occurs in the big full ragel grammar. It seems as if the default machine doesn't match correctly for certain characters, but I have no idea why so far.

Show
Ola Bini added a comment - This definitely looks like a bug in ragel, but I haven't been able to narrow it down at all - it only occurs in the big full ragel grammar. It seems as if the default machine doesn't match correctly for certain characters, but I have no idea why so far.
Hide
Permalink
Charles Oliver Nutter added a comment -

Still valid?

Show
Charles Oliver Nutter added a comment - Still valid?
Hide
Permalink
Thomas E Enebo added a comment -

Not on a branch but from last release of RedCloth, then I can still see this:

jruby -e 'require "rubygems"; require "redcloth"; puts RedCloth.new("Français").to_html'
Show
Thomas E Enebo added a comment - Not on a branch but from last release of RedCloth, then I can still see this: jruby -e 'require "rubygems"; require "redcloth"; puts RedCloth.new("Français").to_html'

People

  • Assignee:
    Ola Bini
    Reporter:
    Diego Elio Pettenò
Vote (0)
Watch (0)

Dates

  • Created:
    Updated: