Cbdocloader dies


#1

Where is the best place to report bugs for couchbase?

I am trying to load data using cbdocloader, but it dies.

Linux Centos 5.6 x64 Couchbase 3.01

Here is the screen dump:

[root@rpzcentos bin]# ./cbdocloader -u Administrator -p diener -n localhost:8091 -b default -s 100 /download/UserNameDump.json
[2014-12-03 03:32:07,199] - [rest_client] [140524311340800] - INFO - existing buckets : [u’default’]
[2014-12-03 03:32:07,199] - [rest_client] [140524311340800] - INFO - found bucket default
bucket creation is successful
Exception in thread w0:
Traceback (most recent call last):
File “/usr/lib64/python2.6/threading.py”, line 532, in __bootstrap_inner
self.run()
File “/usr/lib64/python2.6/threading.py”, line 484, in run
self.__target(*self.__args, **self.__kwargs)
File “/couch/lib/python/pump.py”, line 287, in run_worker
source_map, sink_map, self.ctl, curx).run()
File “/couch/lib/python/pump.py”, line 345, in run
rv_batch, batch = self.source.provide_batch()
File “/couch/lib/python/pump_json.py”, line 166, in provide_batch
JSONSource.save_doc(batch, dockey, fp)
TypeError: save_doc() takes exactly 4 arguments (3 given)

^CTraceback (most recent call last):
File “/couch/lib/python/cbdocloader”, line 330, in
pump_transfer.exit_handler(DocLoader().main(sys.argv))
File “/couch/lib/python/cbdocloader”, line 318, in main
self.populate_docs()
File “/couch/lib/python/cbdocloader”, line 270, in populate_docs
self.enumerate_and_save()
File “/couch/lib/python/cbdocloader”, line 227, in enumerate_and_save
for item in os.listdir(subdir):
OSError: [Errno 20] Not a directory: ‘/download/UserNameDump.json’
[root@rpzcentos bin]#


#2

You want to report it here: http://www.couchbase.com/issues/browse/MB

You also want to select the component “tools” I think.


#3

You may find this hard to believe, but the bug reporting system has a bug and I cannot register, login, NADA!

Maybe you could copy my screen dump there and report the bug.

Then open an issue in the bug system about not being able to register or log in to the bug system.

Thanks,

md


#4

Also, what other option is available to bulk load JSON data without using cbdocloader?

Or I can get into the python a debug it.


#5

@md1 oh that’s not good. I’ll contact someone from the tooling team to help you out here directly.


#6

Try this
./cbdocloader -u Administrator -p diener -n localhost:8091 -b default -s 100 /download

Either you provide a directory that contains all json files that are to be uploaded, or you create a zip file that contains all json files. The error message clear indicates that the tool expects a directory instead of a file.


#7

Sorry about that, I see now after looking closely at the python exception stack that it barfs on inproper input.

Maybe just have Python report the problem and skip the whole business about only 3 arguments provided for a 4 argument function, etc.

I will keep going using the Talend suggestion on your web site for data migration into couchbase.

Cheers

md