Scribd Logo
Upload

Welcome to Scribd!

  • Lab 1 DFD

    Uploaded by

    Pac SaQii
    7 views1 page
    The document describes an indexing process that takes text files from a given directory, splits the files into sentences, tokenizes the sentences into individual words, stems verbs, and adds entries to an inverted index data structure to map words to the files containing those words along with a count of occurrences. It exits if no files are found or if the user enters "q", and provides a search function to match user queries against the inverted index and return related documents.

    Original Description:

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document describes an indexing process that takes text files from a given directory, splits the files into sentences, tokenizes the sentences into individual words, stems verbs, and adds entries to an inverted index data structure to map words to the files containing those words along with a count of occurrences. It exits if no files are found or if the user enters "q", and provides a search function to match user queries against the inverted index and return related documents.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    7 views1 page

    Lab 1 DFD

    Uploaded by

    Pac SaQii
    The document describes an indexing process that takes text files from a given directory, splits the files into sentences, tokenizes the sentences into individual words, stems verbs, and adds entries to an inverted index data structure to map words to the files containing those words along with a count of occurrences. It exits if no files are found or if the user enters "q", and provides a search function to match user queries against the inverted index and return related documents.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 1

    Start

    create_Index

    Input

    get Document of
    type .txt from
    given dir Char
    Yes End
    is 'q'

    No

    If there is a file No
    Exit indexer
    Search
    function
    Yes

    Read the file


    and split it into
    sentences No

    Tokize the
    Tokenizer user query
    For each
    sentence,
    tokenize it into
    words

    stem the
    verbs

    if word is
    noun or verb
    verb stem the verb

    Match the
    word from the
    indexer
    noun word is
    already in
    indexer?

    No
    Returns the
    matching
    add an entry in document
    the inverted related to
    index pointing to words
    this filename

    Display the
    result

    add count

    stores filename
    and count

    You might also like