Questions tagged [elasticsearch]
Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine built on top of Lucene.
47 questions
0
votes
0
answers
46
views
Handling different flows in data streams in elasticsearch via separate indices
I have been using data streams for my business flow logs, each flow has the different log structure. I have couple of solutions in mind:
Having same structure for each flow and keep stringified ...
- 101
0
votes
1
answer
40
views
Finding related items in OpenSearch between 2 datasets
I have a scenario where I have 2 sets of data:
All possible products
Products carried by a store
Dataset 2 is a subset of dataset 1.
If a user searches for a product that the store doesn't carry, I'...
- 28.2k
0
votes
1
answer
80
views
How to architect an in-app search solution that accounts for access to data?
I have a lot of data that I would like to enable end-users to search on. I plan to use ElasticSearch (but am open to other technologies). This would also be an AWS native solution. For simplicity, let'...
- 101
-2
votes
1
answer
727
views
How to create Business rule engine in PostgreSQL? [closed]
Our organization is into Health Care RCM business. In that, we use to receive medical records (called as accounts, which is a business phrase) and our staff (Medical coders) use to do medical coding, ...
- 9
0
votes
1
answer
786
views
REST API Design: Should we have separate endpoints for same resource if the system uses both ElasticSearch and MySQL?
Suppose we have a resource which uses either MySQL or ElasticSearch, depending on whether the query params require full-text search or not.
For example the possible query filters are:
fk_id which is a ...
- 121
1
vote
0
answers
125
views
Backend Design: System requires both ElasticSearch and MySQL. In which scenario we fetch data from MySQL or ElasticSearch?
So, one of the backend system, having 5 resource types (tables) and some foreign keys as well, requires full text support for two of the tables.
Also, for some use-cases, we require inner-joins for ...
- 121
2
votes
2
answers
2k
views
What is the advantage of Kafka connector to MongoDB over using MongoDB change streams?
I need to stream changes from my MongoDB instance to Elasticsearch. I also need to perform complex transformations on changed documents. After doing some research I narrowed my options down to 2:
...
- 167
0
votes
1
answer
369
views
Do I have to use Filebeat to parse logs with logstash?
I was under the impression that Filebeat is only necessary if I wish to provide a constant, paced, fresh input to logstash.
But the tutorial here starts with configuring Filebeat to send log lines to ...
- 119
2
votes
1
answer
143
views
eCommerce category path - names vs IDs
I am building an eCommerce website and there is a Category table in my MongoDB database which has a field called path. This field is used to store category hierarchy e.g Boots category will have /...
- 129
0
votes
0
answers
42
views
Filtering data from elastic search based on mongodb
I've a list of items in my ElasticSearch.
User enters a query and I fetch the results from elastic search. Now, I've a requirement where I don't want to show the user the items which he has already ...
2
votes
1
answer
117
views
Elasticsearch and RDMBS combination
I read both this thread Elasticsearch and PostgreSQL combination and this one Elasticsearch and relational database combination, but I could not come to an answer.
Let's say I have to re-create a ...
- 29
1
vote
0
answers
203
views
Combine/Sync Amazon S3 and MongoDB Atlas with Elastic Search
I have many continuously growing (through scrapping) collections in MongoDB Atlas. The documents in each collection follows the following schema:
{
"source_url": "<some url on the web>",
"html":...
- 111
5
votes
1
answer
450
views
ReactJS with Elasticsearch app architecture
I want some advice regarding my architecture and hosting options.
I'm attempting to build an e-commerce site for e-books. It will use NestJS for the backend and ReactJS+Typescript for the frontend.
...
- 51
0
votes
0
answers
239
views
Elastic Search inverted index and index containing actual documents?
I have gone through Elastic working and understands how inverted index(faster look up) and index(
storing actual document disk in ES). My understanding is that inverted index has most of the required ...
- 1,886
2
votes
1
answer
2k
views
Elasticsearch and PostgreSQL combination
I have a marketplace application and I stored data in a PostgreSQL. I have performance problem for product search, I know I can improve search performance if I use Elasticsearch instead of PostgreSQL ...
- 53