0% found this document useful (0 votes)

83 views

Stefano Bargioni - Koha Gruppo Italiano: Kohala Symposium - Lyon, June 28Th, 2016

This document summarizes the work of the Koha Gruppo Italiano in integrating Elasticsearch into Koha. It describes how the group secured funding from EBSCO to develop Elasticsearch support, browse functionality, and other improvements. It outlines the technical work completed, including rebuilding Elasticsearch indices and configuring mappings. The document concludes by discussing future plans, such as developing a common query parser and further grants to integrate acquisitions and ERM tools.

Uploaded by

pablomartinezdiez

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

83 views

Stefano Bargioni - Koha Gruppo Italiano: Kohala Symposium - Lyon, June 28Th, 2016

Uploaded by

pablomartinezdiez

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 28

Intégration

d'Elasticsearch
dans Koha
Stefano Bargioni - Koha Gruppo Italiano
KohaLa Symposium - Lyon, June 28th, 2016
The Koha Gruppo Italiano

Founded February 20, 2013

Franziska Wallner, AUR

Sebastian Hierl, AAR

Juan Diego Ramírez, PUSC

Stefano Bargioni, PUSC + AUR IT consultant

Paolo Bizzarri (1963-2012)

AUR is the first Koha user, and one of the

first EDS users in Italy 2
The Koha Gruppo Italiano

http://www.kohagruppoitaliano.it

Snoopy was drawn at KohaCon12

When the KGI was looking for a logo, we modified

its dream into the Italian flag

The thinking dog is very Ko-happy to stay in Lyon

3
The limitations of Zebra

The power of Zebra

Better facets

The need of a browse search method

The French experience with Solr

New requirements from RDA, FRBR, RDF...

4
5
A browse Search Method

It mimics a card catalog

Relevant for "see" and "see from"

entries

Count of records, links to relevant

external resources

Based on Solr

No way to do it using Zebra?

6
A browse Search Method

Academic browse

Authors

Titles

uniform

series

Subjects

Dewey
7
…
The French Experience with Solr

Many reasons to participate in KohaCon12:

Meet the Koha Community

Meet BibLibre and share ideas about Solr in Koha

Present the browse search method

8
Hackfest 2014, Marseille

What about to replace Zebra?

Do you prefer Solr, Elasticsearch, another noSQL engine...?

We will need a lot of money!

9
Where Funds can come from?

Events organized by Koha Gruppo Italiano have sponsors not related to

Koha

Their companies are interested in open source in libraries

add flexibility to IT services

save money for the ILS, and spend it for other products

They can fund projects, if they trust in Koha and in its community

10
The First Grant

Gianluca Di Bella, VP of Sales, EBSCO Information Services - Latin

Europe and Israel

Some months later, Ebsco accepted: N,000 USD for Elasticsearch

One more month, Ebsco final decision: 2N,000 USD for Elasticsearch and
some more goals

Jan 10, 2014 - "Carrol Preston Barber Research Grant" requested from
ALA - Unsuccessful

11
The Goals of the First Grant

Strategic upgrade of Koha's core full-text search engine technology to ElasticSearch

Increased functionality and accuracy of facets

Development of a browse function (author, title, subject, call number)

Improved speed

Full OPAC functionality within EBSCO Discovery Service User Interface via Koha
API for:

Renewals

Holds

Transaction history of Fines

12
Cataloging in a Linked Data Environment

13
The Flow

The whole grant from Ebsco to AUR

A description of the work done, followed by an invoice from ByWater Solutions to

AUR

Three invoices

14
The Agreements - Memo of Understanding

An agreement between Ebsco and The American

University of Rome

An agreement between the American University of Rome and ByWater Solutions

Include deadlines

ByWater Solutions will coordinate the realization, eventually involving other companies

A chain of trust
15
The Decision About the Realization

Hackfest,
Marseille 2015

Who will do the job?

16
Elasticsearch in Koha, as of 16-05

17
Elasticsearch in Koha, as of 16-05

The main "bug": 12478 - Elasticsearch support for Koha

An important signoff:
Bug 14899 - Mapping configuration page for Elastic search

Bug 14567 - Browse interface for OPAC

18
Elasticsearch in Koha, as of 16-05

/usr/share/koha/

lib/Koha/SearchEngine/Elasticsearch/QueryBuilder.pm

lib/Koha/SearchEngine/Elasticsearch/Search.pm

intranet/cgi-bin/admin/searchengine/elasticsearch/mappings.yaml (2695 rows) for auth and

bib tags

19
Elasticsearch in Koha, as of 16-05

Specific tool(s):

bin/search_tools/rebuild_elastic_search.pl

20
Install Elasticsearch 1.7

https://wiki.koha-community.org/wiki/Elasticsearch

http://debian.koha-community.org/koha/otherthings/elasticsearch_deps.tar.gz

Do not use http://debian.koha-community.org/koha/otherthings/*.deb

21
Rebuild Elasticsearch Indices

From koha-shell run

bin/search_tools/rebuild_elastic_search.pl

-d (delete)
-v (verbose)
-a (authority)
-b (bibs)
-h (help)

22
Zebra and Elasticsearch

When Elasticsearch is active, Zebra cannot be stopped, if Z39.50

server is required

You can switch back and forth between Elasticsearch and Zebra, but
ES indices must be rebuilt

I experienced unsuccessful queries using Elasticsearch ...

23
QueryParser

QueryParser, a new layer for Zebra, Elasticsearch, and… Solr?

"This will allow us to migrate completely away from C4::Search.

The idea is that with the QueryParser we could pass any search and then
have it output into multiple search engines in the query language that they
want.
So there would be a Zebra driver, a ES driver, a SOLR driver (whatever
driver someone wanted)." (Brendan G.)

24
The Second grant