In many clinical trials, patient outcomes are often binary-valued which are measured asynchronously over time across various dose levels. To account for autocorrelation among such longitudinally observed outcomes, a first-order Markov model for binary data is developed. Moreover, to account for the asynchronously observed time points, nonhomogeneous models for the transition probabilities are proposed. The transition probabilities are modeled using B-spline basis functions after suitable transformations. Additionally, if the underlying dose-response curve is assumed to be non-decreasing, our model allows for the estimation of any underlying non-decreasing curve based on suitably constructed prior distributions. We also extended our model to the mixed effect model to incorporate individual-specific random effects. Numerical comparisons with traditional models are provided based on simulated data sets, and also practical applications are illustrated using real data sets.