Bug 728585 - Cannot upload files larger than 10240 bytes
Summary: Cannot upload files larger than 10240 bytes
Alias: None
Product: JBoss Enterprise BRMS Platform 5
Classification: JBoss
Component: Modeshape
Version: BRMS 5.2.0-ER1
Hardware: Unspecified
OS: Linux
Target Milestone: ---
: BRMS 5.2.0.GA
Assignee: Van Halbert
QA Contact: Jiri Locker
Depends On:
TreeView+ depends on / blocked
Reported: 2011-08-05 17:29 UTC by Jiri Locker
Modified: 2021-09-15 11:50 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Last Closed:
Type: ---

Attachments (Terms of Use)
File to reproduce the bug (10.00 KB, text/plain)
2011-08-05 17:29 UTC, Jiri Locker
no flags Details
server.log (2.04 KB, text/plain)
2011-08-05 18:05 UTC, Jiri Locker
no flags Details
modeshape-config.xml (6.69 KB, application/xml)
2011-08-08 08:14 UTC, Jiri Locker
no flags Details
Simple Test to load nt:file node (5.91 KB, application/octet-stream)
2011-08-16 12:58 UTC, Van Halbert
no flags Details
modified JSP test (7.06 KB, text/plain)
2011-08-17 09:50 UTC, Jiri Locker
no flags Details

Description Jiri Locker 2011-08-05 17:29:59 UTC
Created attachment 516929 [details]
File to reproduce the bug

Description of problem:
Attempt to upload a file that is larger than 10240B causes java.nio.channels.ClosedChannelException. See attached server.log for full stack trace. User cannot upload files like JAR models or spredsheet decision tables etc., that exceed the 10240 bytes limit in size.

Version-Release number of selected component (if applicable):
ModeShape 2.5.1.GA

How reproducible:

Steps to Reproduce:
1. create new properties file in any package
   Create New > Create a file. > (type "properties" for the file extension)
2. try uploading attached 10241B.properties
Actual results:
Error message displayed. The exception can be found in server.log.

Expected results:
File can be uploaded without errors.

Comment 1 Jiri Locker 2011-08-05 18:05:47 UTC
Created attachment 516932 [details]

Comment 2 Van Halbert 2011-08-07 15:15:45 UTC
Can you attached the modeshape configuration file: modeshape-config.xml

Comment 3 Jiri Locker 2011-08-08 08:14:16 UTC
Created attachment 517127 [details]

Comment 4 Lukáš Petrovický 2011-08-09 07:19:22 UTC
I believe that bug 724542 comment 6 was actually intended to land in this bug. :-) Am I right, Van?

Comment 5 Van Halbert 2011-08-09 12:40:27 UTC
You are absolutely right.

Now that BRMS ER2 is out, can you retest this?   After talking with rhauch, I
used the latest modeshape code in SOA and publish 16k and 22k size files, which
one was a jar, with no issue.   And because the same engine and connectors in
BRMS are also in SOA, we should have seen the problem, but I didn't.

Comment 6 Jiri Locker 2011-08-09 14:32:04 UTC
Nothing new with BRMS 5.2.0.ER2. The exception can be easily reproduced using brms-standalone package, installing MS according to BRMS Administration Guide. Default HSQL database was used, modeshape-config.xml is identical to attachment 517127 [details].

Comment 7 Van Halbert 2011-08-09 14:57:22 UTC
Kurt, we need someone from the brims group to create a test case outside of using the client tool to validate this issue.     Our test cases  are not seeing this issue, nor is it an issue in SOA.

Comment 8 Lukáš Petrovický 2011-08-12 14:00:59 UTC
Jirka, would you please take a look at this when you are back from your PTO? We need a better test case that would reproduce it for Van and his team. 

The current test case doesn't seem to do the trick.

Comment 9 Anne-Louise Tangring 2011-08-12 15:27:06 UTC
This is for ModeShape.Candidate only.

Comment 10 Jiri Locker 2011-08-16 09:19:12 UTC
Van, Kurt, if you find it difficult to reproduce this bug, please follow this step-by-step 5 minutes procedure. Someone has to decide if it is a bug in ModeShape or Guvnor, or if it's just a misconfiguration. Don't hesitate to contact me with any questions regarding the bug reproducing.

For more details on steps 2-5, see http://documentation-stage.bne.redhat.com/docs/en-US/JBoss_Enterprise_BRMS_Platform/5/html-single/BRMS_Administrator_Guide/index.html#sect-install-modeshape

1. install BRMS 5.2.0.ER2 standalone package
$ wget --no-check-certificate https://hudson.qa.jboss.com/hudson/view/BRMS/job/brms-5.2/lastSuccessfulBuild/artifact/signed/jboss-brms-standalone.zip
$ unzip jboss-brms-standalone.zip

2. install ModeShape into default profile
$ cd brms-standalone-5.2.0/modeshape/ && ant

3. setup users
$ cd ../jboss-as-web/server/default/
$ vi conf/props/brms-users.properties # just uncomment the two users

4. switch to ModeShape repository
$ cd deploy/jboss-brms.war/WEB-INF/
$ vi components.xml # just delete the Jackrabbit properties and uncomment ModeShape properties

5. remove unused JARs
$ cd lib/
$ rm jackrabbit-* hibernate-* lucene-core-2.4.1.jar jcr-2.0.jar

6. start the server
$ cd ../../../../../..
$ ./bin/run.sh -c default

7. reproduce the bug
- log into Guvnor by opening http://localhost:8080/jboss-brms/ and providing admin:admin credentials
- do not import the sample repository when asked (click 'No thanks')
- expand the Knowledge Bases section on the left-hand panel
- issue Create New > Create a file.
  enter file name
  type 'properties' as the file extension
  click 'OK'
  a new asset opens
- try uploading the reproducer file from attachment 516929 [details]
  the attempt should end with an error box saying 'Unable to upload the file.'
  an exception can be found on the console output and server.log:

10:30:51,865 ERROR [[AssetFileServlet]] Servlet.service() for servlet AssetFileServlet threw exception
	at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:109)
	at sun.nio.ch.FileChannelImpl.size(FileChannelImpl.java:320)
	at org.modeshape.graph.property.basic.FileInputStreamBinary.getSize(FileInputStreamBinary.java:81)

Comment 11 Van Halbert 2011-08-16 12:58:45 UTC
Created attachment 518482 [details]
Simple Test to load nt:file node

Attached I've added a jsp that performs adding a text file that is larger than the 10240 that is used by the Gov. test.     This is a simple test that add, finds and deletes the nt:file node.   I was unable to recreate the issue.    So that we can get to the details of how the Gov. logic is actually performing its task, how can I change this logic to replicate what Gov. is doing?

Comment 12 Jiri Locker 2011-08-17 09:50:23 UTC
Created attachment 518634 [details]
modified JSP test

Attaching a slightly modified JSP test case. I've added a parameter 'file' to specify a file from which to read data for the node. Most important change is that I'm using ValueFactory.createBinary(java.io.InputStream stream) to create the value for the jcr:data property of the sample node.

To invoke the exception, try a request similar to

> http://localhost:8080/test.jsp?repo=brms&file=/tmp/test.txt

where /tmp/test.txt can have an arbitrary content (e.g. "test").

Van, do you have any idea how to avoid having the Binary's InputStream closed at this point:

> org.modeshape.connector.store.jpa.util.Serializer.serializeProperty(Serializer.java:315)

Or is this way of using the API not intended and so Guvnor needs change the client code?

Comment 13 Van Halbert 2011-08-17 21:32:54 UTC
With your changes I've been able to reproduce the issue in a junit test, and the solution is being worked on.

Thanks,  Jiri.

Comment 14 lcarlon 2011-08-18 05:47:16 UTC
Marked as not needing a release as this issue appears to be between internal builds.

If it should have a release note, please set the technical_not flag to '?'

- Lee

Comment 15 Van Halbert 2011-08-19 21:32:45 UTC
The fix has been committed to modeshape 2.5.x branch:  COMMIT ID:  b33eadc2047e18247938

There was an issue in which the binary file was getting serialized twice, but the second try would fail because the stream was closed after the first serialization.

Comment 16 Lukáš Petrovický 2011-08-20 07:36:05 UTC
Transferring this to MODIFIED state so that it can be pick up by the QA contact for verification.

Comment 17 Prakash Aradhya 2011-08-23 19:30:49 UTC
Although Modeshape is downgraded to TP, this is not an acceptable issue to have in the product.

Comment 18 Van Halbert 2011-08-23 19:37:48 UTC
As stated in COMMENT 16, this issue has been fixed and committed to ModeShape.  It should be picked up in the next build.

Comment 19 Jiri Locker 2011-09-22 15:43:17 UTC
Fix verified in BRMS 5.2.0 ER3.

Note You need to log in before you can comment on or make changes to this bug.