Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for field indexing via manual import #946

Open
zstumgoren opened this issue Jan 12, 2015 · 0 comments
Open

Add support for field indexing via manual import #946

zstumgoren opened this issue Jan 12, 2015 · 0 comments

Comments

@zstumgoren
Copy link

This is a minimally invasive addition to the Dataset.import_data method and manual_import command. The change allows users to specify field-level indexes during bulk import, and opens the door to configuring field-level search from the web interface as well (if anyone is interested in that feature).

I had to add this support in order to sidestep performance issues during re-indexing a "large" dataset of about 18 million rows. I plan to file another issue related to re-indexing performance and/or inquire about the issue on the GGroup, but wanted to send this along in meantime in case you all wanted to integrate into core. Pull request related to this issue to follow shortly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant