opencsv Activity
Brought to you by:
aruckerjones,
sconway
Activity for opencsv
-
Louis Schirmer created ticket #256
CsvToBean created with CsvToBeanBuilder fails to correctly parse quotations when additional whitespaces present
-
Max created ticket #255
Bug in ResultSetColumnNameHelperService class when printing CSV of a table with multiple columns of the same name
-
Scott Conway committed [fc74df] on Source
made changes suggested by Jetbrains AI Assistant
-
Merge remote-tracking branch 'origin/master'
-
test created from a support request about handling double quotes.
-
made changes to AbstractCSVParser suggested by IntelliJ AI Assistant.
-
made changes to AbstractCSVParser suggested by IntelliJ AI Assistant.
-
updated javadocs and corrected misspellings.
-
Kiran Velumuri created ticket #170
commons-collections transitive dependency in opencsv:5.10
-
LOL - it is not a death sentence.... But I guess I do understand thinking about it. I always go to the unit tests for samples but I realized reading my original response that I could because I wrote half of them. That said the unit tests should be good for part of what you want as they are pretty much stand alone and I am sure there will be test code for the collections. The downside is you will have to search for it. Consider looking at the CollectionSplitTest.java, JoinTest.java, or FuzzyMappi...
-
Doug Merrett posted a comment on a wiki page
Thanks for that Scott. I will have a dig around.
-
Hello Doug - So there are two sources of examples you can look through other than the documentation (https://opencsv.sourceforge.net/#collection_based_bean_fields_one_to_many_mappings). One is the unit tests - just clone the repo (https://sourceforge.net/p/opencsv/source/ci/master/tree/) and search through the existing unit tests and integration tests and I am sure there will be samples of what you are looking for. The other is searching or asking on stack overflow (https://stackoverflow.com/search?tab=newest&q=opencsv&searchOn=3)...
-
Hi folks, may I ask a favour? Your samples directory in the source area is very, very light on in the way of code. There is only one simple example and the snippets in the documentation do not compile correctly. I fully understand I am a java newbie, however I learn by reading and have tried many other sites trying to get a bean reader working. Could you please post the complete code used for the snippets in the Collection-based bean fields (one-to-many mappings) area of the doc? Preferably, complete...
-
Sergei Chernov created ticket #127
commons-beanutils update to 1.10.1
-
Oliver Heimlich posted a comment on ticket #254
Hello Scott, I am now going with the RFC4180Parser and it solves my problem perfectly. Thank you very much for your swift reply and taking the time to explain what I have missed. You truly have made my day. Best regards Oliver
-
Parsing of multiple quote characters inside of unquoted field
-
Hello Oliver This is not a bug but a misunderstanding of the CSVParser. I cases like yours my default response has always been and always will be switch to the RFC4180Parser. The CSVParser predates the RFC4180 specification and is way more configurable but at the price that it is not always compatible with the now established CSV specifications. In this case if you have a quote character in your data you need to surround that string with quotes otherwise the CSVParser will not process it properly....
-
Parsing of multiple quote characters inside of unquoted field
-
ConverterPrimitiveTypes made with #242 breaks existing software
-
Hello Setfan - go ahead and send a PR if you have some sample code (and hopefully test) and I will do my best to look at it this weekend. Right now I am thinking of changing the ConverterPrimitiveTypes code that is doing the register from : if(this.locale == null) { readConverter = BeanUtilsBean.getInstance().getConvertUtils(); readConverter.register(true, false, 0); readLocaleConverter = null; } to if(this.locale == null) { readConverter = BeanUtilsBean.getInstance().getConvertUtils(); readLocaleConverter...
-
Stefan Person created ticket #253
ConverterPrimitiveTypes made with #242 breaks existing software
-
create 5.10.1 snapshot version
-
Roll back the changes to the maven site plugin. The new version was not picking up the asciidocs
-
Added additional tests after Merge #36. Corrected issues brought up by mvn site:site build
-
5.10 has been released
-
What's new
-
opencsv released /opencsv/5.10 sources/opencsv-5.10.pom.asc
-
-
-
-
-
-
-
-
What's new
-
Updated dependencies
-
That is awesome. I will look at trying to update to 1.10 shortly. I do see it on maven!! https://central.sonatype.com/artifact/commons-beanutils/commons-beanutils/versions I won't update to 2.0 until they have had a couple of actual releases, not milestone releases, to work out any issues found in the new major release. And that will give us time to see if there are any backwards compatibility issues.
-
Jeff Thomas modified a comment on ticket #251
FYI there is also now a 2.0.0-M1: https://commons.apache.org/proper/commons-beanutils/changes-report.html#a2.0.0-M1 But incompatible changes: "Change packaging from org.apache.commons.beanutils to org.apache.commons.beanutils2."
-
FYI there is also now a 2.0.0-M1: https://commons.apache.org/proper/commons-beanutils/changes-report.html#a2.0.0-M1
-
Hi Scott - it finally happened :P https://commons.apache.org/proper/commons-beanutils/changes-report.html#a1.10.0 https://github.com/apache/commons-beanutils/blob/rel/commons-beanutils-1.10.0/pom.xml Its not visible on MVN Repo yet and the BeanUtils page hasn't been fully updatetd yet but Gary sent out the Apache Release Email today. BeanUtils 1.10.0 is now using Commons Collections 4.5.0-M3 So... Happy New Year!!! :P
-
Hi Scott - it finally happened :P https://commons.apache.org/proper/commons-beanutils/changes-report.html#a1.10.0 https://github.com/apache/commons-beanutils/blob/rel/commons-beanutils-1.10.0/pom.xml Its not visible on MVN Repo yet and the BeanUtils page hasn't been fully updatetd yet but Gary sent out the Apache Release Email today. BeanUtils 1.10.0 is now using Commons Collections 4.5.0-M3
-
Create Multiple CSV For SQL Result Set
-
I am sorry but I am rejecting this as this would entail a LOT of work for little gain. You are better served just creating multiple queries and sending those result sets to the files you want.
-
Create Compressed CSV Files
-
closed for lack of response
-
Gordon I am sorry it took so long to respond but life has been busy. The functionality you want is in the HeaderColumnNameTranslateMappingStrategy. If you look at the test code (either by downloading it or going to https://opencsv.sourceforge.net/xref-test/index.html) look at HeaderColumnNameTranslateMappingStrategyTest at the onlyConvertWhatIsInTheMap test. Hope that helps! Scott :)
-
CsvCustomBindByName does not honor converter setting
-
Sorry it took so long to reply but I was able to load your test, downgrade it to Java 8, and the problem was apparent. The bind by name and bind by position annotations are not interchangable. If you use the CsvCustomBindByPosition then you use the ColumnPositionMappingStrategy and when you use the CsvCustomBindByName then you should map with the HeaderColumnNameMappingStrategy. Your problem was you were using the position strategy for both the name and position annotations. When I modified your...
-
Support validation against unknown columns
-
Gordon posted a comment on ticket #167
FWIW, I ended up adding a custom mapping strategy public class StrictColumnNameMappingStrategy<T> extends HeaderColumnNameMappingStrategy<T> { @Override public void captureHeader(CSVReader reader) throws IOException, CsvRequiredFieldEmptyException { super.captureHeader(reader); String[] header = headerIndex.getHeaderIndex(); List<String> unknownHeaders = IntStream.rangeClosed(0, headerIndex.findMaxIndex()) .filter(column -> findField(column) == null) .mapToObj(this::getColumnName) .collect(Collectors.toList());...
-
Kajetan Kacper Maj posted a comment on ticket #252
Thank you. No need to apologize, I'm very grateful to people that donate their time for others without wanting anything in return. The least I can do is to be patient :)
-
CsvCustomBindByName does not honor converter setting
-
Sorry I have not responded, especially since you gave an excellent test, but life and work has been really busy. I was hoping to take a look at it this weekend but have not had a chance but I wanted to let you know we are still alive and will look at it when possible.
-
I will keep checking on occasion but thus far I do not see anything published. Please let me know if you see it published.
-
Carriage returns considered part of quoted data
-
Closed for lack of response.
-
I forgot to include one annotation, please paste it at the end of the code since I cannot edit the post. @Retention(RetentionPolicy.RUNTIME) @Target(ElementType.FIELD) public @interface CsvBigDecimalFormat { String format(); }
-
CsvCustomBindByName does not honor converter setting
-
Create Compressed CSV Files
-
There is no need as Java already has built in libraries to read and write gzip files. https://medium.com/javarevisited/efficient-handling-and-processing-of-compressed-files-in-java-7d023551168c Using the GZIPOutputStream - https://docs.oracle.com/javase/8/docs/api/index.html?java/util/zip/ZipOutputStream.html Using an OutputStreamWriter as a wrapper of the GZIPOutputStream you have a writer that you can create a CSVWriter with and you are now creating compressed csv files. https://www.tutorialsp...
-
Prashant created ticket #169
Create Multiple CSV For SQL Result Set
-
To be able to create/write to compressed csv to save disk space and faster file transfer
-
Create Compressed CSV Files
-
Alexey Pelykh created ticket #126
Support Java's record
-
Hi Scott, I actually did message Gary a few months ago and ended up on the Apache mailing list. Gary Gregory announced yesterday via the mailing list that they expect to have a beanutils2 release-candidate in around one month.
-
Support validation against unknown columns
-
Added additional tests after Merge #36. Corrected issues brought up by mvn site:site build
-
What's new
-
b'Scott Conway committed [0bdd1d] on Source
Merge /u/sdaubin/opencsv/ branch master into master
-
Enhancement - add withType method to mapping strategy builders
-
b'Scott Conway committed [fc1a2f] on Source
Merge /u/cy2008/opencsv/ branch master into master
-
Enhancement
-
czp posted a comment on ticket #166
Thanks for your patience, now I know that 'profile' means maven profile. But that's what I don't understand. opencsv as a dependency library, rather than as a standalone application, only needs a few additional resource files to support graalvm. This does not cause jdk version incompatibility or jdk provider incompatibility. It also doesn't ask for the jdk version at compile time, unlike java9 module-info. The graalvm files (as written above) are just normal resource files that don't affect anything...
-
Hello czp. When I talked about a profile I meant that I was willing to add or allow someone to add a graalvm profile in our maven pom.xml. You can see an exampe of that in the maven section of the graalvm page. The benefit of this is that IF changes required to make the native image are incompatible with our current requirements (like requiring a newer version of Java than Java8) we can loosen those restrictions for the graalvm profile for people who priortize that but leave the defaults alone. If...
-
I'm not sure what you mean by "profile", do you mean https://www.graalvm.org/latest/reference-manual/native-image/guides/optimize-native-executable-with-pgo/ ? PGO is a graalvm native image optimization, and does not critically determine whether or not opencsv will run properly on the native image. "Support for graalvm native image" means that opencsv, as a library, can execute correctly when used as a dependency in a standalone application. I'm sorry, but I've always used github and don't really...
-
I took a look at the graalvm and have no problem creating a profile - though wouldn't it need to be a native shared library as opencsv is not a stand alone application? As long as it is added as a new profile feel free to make the change yourself and submit a merge request as it will be a while before I have free time to take a look at this.
-
Hello Saxon Thanks for the merge request. I will try and get a closer look at it next week as this week is very busy at work and at home we are getting ready for the labor day weekend :) If you get a chance, if not I will do it if everything else looks good, please copy the tests you modified and have one with the setType and the other with the withType to show that the code change maintains backwards compatibility. Sincerely Scott :)
-
Saxon created merge request #36 on Source
Enhancement - add withType method to mapping strategy builders
-
support graalvm native image
-
Go ahead and message Gary Gregory to see when they are planning on a release of commons-beanutils. Yeah they are still making code changes but the last release they made was almost five years ago (https://central.sonatype.com/artifact/commons-beanutils/commons-beanutils/versions) so there are a whole bunch of apache commons libraries that are in what I call "development hell" because changes are constantly being made but no releases are being made.
-
Hi Scott, came here looking for this exact ticket because of the CVE vulnerability lighting up in my IDE. Just a hint, the last code changes in beanutils were just 3 days ago. Maybe it is possible to message the maintainer Gary Gregory about a release? :) The master was already switched to commons-collections4 back in September 2023.
-
Cx78f40514-81ff,
-
Sorry I am closing this one. If you do a mvn dependency:tree on the opencsv project or just look at the pom file you see we are using the latest version (4.4) of common-collections4 mvn dependency:tree [INFO] Scanning for projects... [INFO] [INFO] ------------------------< com.opencsv:opencsv >------------------------- [INFO] Building opencsv 5.9.1-SNAPSHOT [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- dependency:3.6.1:tree (default-cli)...
-
MDR created ticket #125
Cx78f40514-81ff,
-
Yeah I am going to close this one. I agree with you with the sentiment about commons-beanutils being a dead project but there is a story here and I wished I knew what it was. If you check you will find that back in 2017 there was a apache commons-beanutils2 created in 2014 but looking at the git branches the first checkin referencing beanutils2 was 2017 (https://commons.apache.org/sandbox/commons-beanutils2/index.html). And looking at the git repo (https://github.com/apache/commons-beanutils) it...
-
Hristo Ivanov posted a comment on ticket #251
Hi Scott, upon further analysis, it appears that commons-beanutils uses FastHashMap, which transitively imports commons-collections 3.2.2 into OpenCSV. This means any developer using OpenCSV who has excluded older versions of commons-collections in the pom file due to the CVE will likely encounter this error. Unfortunately, there has not been an update to commons-beanutils since 2019, suggesting that the project might have been abandoned. It would be great, if you could take a look into this in your...
-
If you have a simple code sample that you can make into a unit test I will try it out. Otherwise I will test it out in the next week or so depending on when I can get free. Thanks for finding this. I am surprised our existing unit tests did not catch it.
-
OpenCSV 5.9
-
Yat Man, Wong modified a comment on ticket #124
thank you both. The reason I have this use case is so that the user can see all the errors during an import, avoiding the need to fix the errors one by one. I could workaround by reading the CSV rows into a Bean where all properties are string and run my validation logic after. For the case of data miss one semicolon, I see OpenCSV is already throwing "CsvRequiredFieldEmptyException: Number of data fields does not match number." I agree just this error is sufficient to indicate the file is corrupted...
-
thank you both. The reason I have this use case is so that the user can see all the errors during an import, avoiding the need to fix the errors one by one. I could workaround by reading the CSV rows into a Bean where all the are type string and run my validation logic after. For the case of data miss one semicolon, I see OpenCSV is already throwing "CsvRequiredFieldEmptyException: Number of data fields does not match number." I agree just this error is sufficient to indicate the file is corrupted...
-
To expand on the cascading errors problem we have had quite a bit of support requests where data was mis quoted causing shifts in the columns so after the first error you really don't know if anything after that is really an error or if its because you are looking at the wrong data for a given column.
-
Andrew Rucker Jones posted a comment on ticket #124
No, BeanVerifier is not meant to support multiple errors in the same row. As far as the implementation goes, BeanVerifier throws an exception if anything is wrong, which interrupts the normal flow of the program. It would be difficult to make that work for multiple errors in one row. Conceptually, I decided not to provide for the case of multiple errors per row because I figured if there was one error, it might create other errors by its mere existence. I'm thinking of programming in compiled languages...
-
Thank you Scott! I tested moving the verifiers into their own class. The behavior I found is only the exception from the first verifier is returned from getCapturedExceptions(), the latter verifiers are not executed after the first verifier thrown an exception for that row. For example in this change, CountryVerifier was set first so getCapturedExceptions() return the exception from that verifier. https://github.com/yatw/openCsvValidationDemo/commit/657a9121e97b0a48ecad938e978e8ab58d34ef99#diff-b238fe60176ed02237cddabacb5b4ab05b6f7c26ede636fe8550faa77797979e...
-
So if you want to look at a working example download the opencsv code and look at AnnotationTest. Specifically the testMultipleExceptionsPerLine method. Looking at your example, which thank you for loading that to github for me as that made it way easier to see what is going on., the first thing that jumped out at me was that you don't need the .withExceptionHandler(new ExceptionHandlerQueue()) as that is the default that is used when you call the .withThrowExceptions(false). You only need to use...
-
Support: Can beanVerifer validate all errors in a row
-
Print header separately
-
Nope. I went back and checked the code, or rather my javadoc, to refresh my memory. The reason an actual bean is necessary is because of the joining and splitting functionality we added a few years ago. Any fields joined on reading and split on writing are represented as a MultiValuedMap, with the exact column names in the index of the map. These names, as in the documented example, might be "Track1," "Track2," "Track3," and so on. These column names do not exist in the class. They only exist in...
-
Automaticaly sorting columns on HeaderColumnNameMappingStrategy
-
I just had a chance to read this. I had only half-understood it while scanning over the ticket early in the morning when I got up two weeks ago. I agree with Scott; this is a pretty good solution, and I can't think of a better way to do this with the built-in functionality of opencsv if you are determined to keep ordering information solely in the annotations. Well done.
-
Six I apologize for taking so long to get back to this. Work and family has been keeping me busy. Me personally I am going to pass on this for two reasons: The first is I actually like your solution!! I believe it was what Andrew was envisioning when he designed the setColumnOrderOnWrite and seeing what you did made me actually understand what Andrew did. Hopefully between now and our next release (nothing planned) I am going to update the documentation ( https://opencsv.sourceforge.net/#changing_the_write_order)...
1 >
