ISO/IEC INTERNATIONAL STANDARD 13249-2 Second edition 2003-11-01 Information technology Database languages SQL multimedia and application packages Part 2: Full-Text Technologies de I'information - Langages de bases de données - MultimédiaSQLetpaquetagesd'application- Partie 2: Texte complet Reference number ISO/IEC 13249-2:2003(E) TEC @ISO/IEC2003 y IHS under itted without license from IHS Not for Resale ISO/IEC 13249-2:2003(E) PDFdisclaimer This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The IsO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by IsO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ?ISO/IEC2003 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, IsO's member body in the country of the requester. ISO copyright office Case postale 56. CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail [email protected] Web www.iso.org Published in Switzerland ISO/IEC2003-Allrightsreserved ermitted without license from IHS Not for Resale ISO/IEC13249-2:2003(E) Contents Page Foreword... Introduction ... . ix 1 2 Normative references . 3 3 Terms and definitions, notations and conventions .. 3.1 Terms and definitions... 3.1.1 Terms and definitions provided in ISO/IEC 13249-1:2002. 3.1.2 Terms and definitions provided in this part of ISO/IEc 13249.. 3.1.3 Terms and definitions taken from ISO/IEc 9075 (all parts). 3.1.4 Terms and definitions taken from ANSI/NISO Z39.19:1993. 3.2 Notations..... 3.3 Conventions 4 Concepts.. 4.1 Concepts taken from ISO/IEc 9075(all parts)... .9 4.2 Text model.. 10 4.3 Text identification facilities 4.3.1 Single word patterns (patterns of the form <word>). .12 4.3.2 Single phrase patterns (patterns of the form <phrase>) .12 4.3.3 Patterns representing sets of single words.. .12 4.3.4 Patterns formed by sets of single phrases .. 4.3.5 Patterns specifying context conditions... 4.3.6 Patterns involving Boolean operators.... 4.3.7 Identification of FullText values which are pertinent to a given text 4.4 Text scoringfacilities. 18 4.5 Language aspects.. 4.5.1 Multilingual texts and patterns 19 4.5.2 Treatment of stop words ..19 4.6 Word normalization... .21 4.7 Types and routines provided by this part of ISO/IEc 13249.. 22 4.7.1 Types and routines intended for public use .... 22 4.7.2 Types and routines for definition ... 22 4.7.3 Technique for defining the semantics of Category 1 Contains methods 22 4.7.4 Complementary SQL-invoked regular functions .. 23 4.8 The Full-Text Information Schema.. 23 5 Full-Text Types. ..25 5.1 FullText Type and Routines . ..25 5.1.1 FullText Type. 5.1.2 Contains Methods 28 5.1.3 Score Methods .30 5.1.4 NumberOfMatches Methods 31 5.1.5 Tokenize Method.. ..32 5.1.6 TokenizePosition Method. .33 5.1.7 Segmentize Method .35 5.1.8 TokenizeAndStem Method .36 5.1.9 TokenizePositionAndStem Method. 5.1.10 FullText Methods..... 5.1.11 Contains Function. 5.1.12 Score Function...... @ ISO/IEC 2003 - All rights reserved Contents ili Copyright Intemational Organization for Standardization Not for Resale ISO/IEC 13249-2:2003(E) 5.1.13 5.1.14 FullText_to_Character Function... .42 5.1.15 StrctPattern_to_FT_Pattern Function.. .43 5.2 FT_TokenPosition Type and Routines. ..44 5.2.1 FT_Tok