Scribd Logo
Upload

Welcome to Scribd!

  • 14 views

    Assignment 2NLP

    Uploaded by

    Usman Hameed FastNU
    This document provides instructions for Assignment 2 on maximum matching for Urdu text segmentation. Students are asked to implement the MaxMatch algorithm to segment 50 unsegmented Urdu sentences using a provided dictionary. They must also calculate the average number of characters per word in a large Urdu text corpus consisting of at least 10,000 tokens scraped from the internet. The assignment must be submitted individually as a zipped file containing code and a report by March 2nd, with late submissions penalized.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content

    You might also like

    Assignment 2NLP

    Uploaded by

    Usman Hameed FastNU
    14 views2 pages
    This document provides instructions for Assignment 2 on maximum matching for Urdu text segmentation. Students are asked to implement the MaxMatch algorithm to segment 50 unsegmented Urdu sentences using a provided dictionary. They must also calculate the average number of characters per word in a large Urdu text corpus consisting of at least 10,000 tokens scraped from the internet. The assignment must be submitted individually as a zipped file containing code and a report by March 2nd, with late submissions penalized.

    Original Description:

    this is related to NLP

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document provides instructions for Assignment 2 on maximum matching for Urdu text segmentation. Students are asked to implement the MaxMatch algorithm to segment 50 unsegmented Urdu sentences using a provided dictionary. They must also calculate the average number of characters per word in a large Urdu text corpus consisting of at least 10,000 tokens scraped from the internet. The assignment must be submitted individually as a zipped file containing code and a report by March 2nd, with late submissions penalized.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    14 views2 pages

    Assignment 2NLP

    Uploaded by

    Usman Hameed FastNU
    This document provides instructions for Assignment 2 on maximum matching for Urdu text segmentation. Students are asked to implement the MaxMatch algorithm to segment 50 unsegmented Urdu sentences using a provided dictionary. They must also calculate the average number of characters per word in a large Urdu text corpus consisting of at least 10,000 tokens scraped from the internet. The assignment must be submitted individually as a zipped file containing code and a report by March 2nd, with late submissions penalized.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 2

    NLP Spring 2023

    Assignment 2: MaxMatch for Urdu


    Instructions:

    • The aim of this assignment is to give you an initial hands-on regarding Urdu Unicode
    processing.
    • You can use any programming language but for your ease Python is highly
    recommended.
    • Feel free to read chapter 2 (Section 2.3.3) of course book (3rd ed.) to get better
    understanding of maximum matching algorithm.
    • You are not allowed to use code (not even a chunk) from the internet.
    • Use a good Unicode text editor (such as BabelPad) to view Urdu files. Here is a link to
    the Unicode Urdu code page.
    • Make a report in PDF format, clearly mentioning question/ part number against your
    answers.
    • This is an individual based assignment. Submit your report and code as one
    compressed file (.zip, .rar) on Google Classroom. The name of file should be
    your roll number i.e. <19L-110--->.zip (This is important)
    • Deadline to submit this assignment is: Friday 2nd March, 2023 11.59 p.m.
    • LATE SUBMISSIONS PENALTY!
    25% after deadline (first day), 50% next day, not acceptable after that.

    Problem No. 1:
    For the first part of this problem you are given 50 unsegmented Urdu sentences and a dictionary
    (wordlist) for lookup. You are required to implement MaxMatch algorithm to segment these
    unsegmented sentences. Write the segmented sentences to a new text file.
    Note: You may pre-process dictionary to simplify the lookup process. Clearly mention your
    approach and pre-processing applied (if any) in not more than 100 words in your report.

    File Details:
    You are given the following files:
    1. wordlist.txt (Dictionary for lookup in MaxMatch)
    2. 50_nospaces.txt (Unsegmented Urdu sentences)
    NLP Spring 2023

    Problem No. 2:
    For the second part of this assignment, you have to calculate average no. of characters per
    word in a running Urdu text. Take a large enough Urdu text corpus (at least 10K tokens) from
    the internet. You can scrap blogs, news website etc. (but not poetry). Clearly mention the links
    in your report. Calculate no. of characters per token and report the average in your report.

    You might also like