You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Search for term in dwc:preparations and Advanced search fields returns unexpected records without search term. #422
Question Answer
First Name Nancy
Last Name Moncrief
Email Address nancy.moncrief@vmnh.virginia.gov
What would you like to tell us about (select one)? Portal/web site issues
Let us know how we can get you started (select one):
Institution or Collection Name
Please give us your feedback, ask your question, or describe your issue. Use as much detail as necessary. You can attach a screen capture and other documentation in the next field below.
"I am trying to locate specimens that include post-cranial elements of 2 species of tree squirrels (Sciurus niger and S. carolinensis). In MANIS, I was able to select "skeleton only" as a preparation type.
Which terms, in which fields on the VertNet portal, should I use to retrieve these data in VertNet?
"skeleton only" as exact phrase retrieves no records
when I put "skeleton" as includes, the search brings up records with the word "skeleton" in the occurence notes field of many records, but not as a preparation type."
COMMENTS:
When attempting to recreate this issue I tested both S. niger and S. carolinensis with several combinations of terms including examples such as [Sciurus carolinensis AND preparations:"skull"], [Sciurus carolinensis AND preparations:skull], [Sciurus carolinensis preparations:skull], as well as Advanced searches that use the term "skull" in the fields for "All these words,", Exact phrase," and "Any of these words."
In all cases I was able to return records for S. niger or S. carolinensis with preparations that included the term "skull". Unfortunately, I also returned records that did not include the term "skull." In all cases, these additional records did not have "skull" in any field within the record, including dwc:preparations. They did include things such as "sample skin," "SS, " and "tissue" among other things that should not have been included in query results.
Carla tested this with genus:aplodontia using the same syntax and the same advanced fields. Her results also returned records with samples skin, tissue, and without skulls.
I realize that dwc:preparations does not use a standardized vocab, but I would expect the search API to return the correct records based on keyword searching.
After doing some testing and reviewing data in big query, the text search is performed against all fields in the indexed verbatim record whether or not those fields appear on the portal screen. So in the example of this record, http://portal.vertnet.org/o/ku/kum?id=149624. The word skull is not visibly present in the portal. However it does appear in the dataset description that is harvested as part of meta data. According to @tucotuco we need to remove verbatim record from full text indexing. See issue: VertNet/dwc-indexer#27
Activity
laurarussell commentedon Sep 19, 2014
After doing some testing and reviewing data in big query, the text search is performed against all fields in the indexed verbatim record whether or not those fields appear on the portal screen. So in the example of this record, http://portal.vertnet.org/o/ku/kum?id=149624. The word skull is not visibly present in the portal. However it does appear in the dataset description that is harvested as part of meta data. According to @tucotuco we need to remove verbatim record from full text indexing. See issue: VertNet/dwc-indexer#27
laurarussell commentedon Jul 2, 2015
Dave can you retest this now that the new index is launched and see if we still have the same issue?
laurarussell commentedon Sep 4, 2015
Preparations added as field to advanced search options.
laurarussell commentedon Sep 10, 2015
Fixed by #563