Published in EMNLP, 2023
paper proposes a general taxonomy that can be used to design prompts with specific properties to perform a wide range of complex tasks. This taxonomy will allow future benchmarking studies to report the specific categories of prompts used as part of the study, enabling meaningful comparisons across different studies.
Download here
Published in NL4AI, 2023
We conduct a comprehensive analysis of LLMs using the existing Fermi reasoning challenge, a task that combines different aspects of reasoning into a single question-answering format, requiring deeper levels of reasoning
Download here
Published in Information Processing \& Management, 2023
Information Retrieval evaluation often use upper bound normalization, what about expected value normalization
Download here
Published in ACM Transactions on Intelligent Systems and Technology, 2022
a novel computational task in this article called Ad-Hoc Topic Tracking, which is essentially a combination of zero-shot topic categorization and the spatio-temporal analysis task
Download here